1 repository
Awesome GitHub RepositoriesSRAM-Aware
Techniques for explicitly managing data movement between high-speed on-chip memory and main device memory.
Distinct from Memory Management: Distinct from general memory management: focuses on hardware-specific SRAM utilization for throughput optimization.
Explore 1 awesome GitHub repository matching operating systems & systems programming · SRAM-Aware. Refine with filters or upvote what's useful.
Awesome SRAM-Aware GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- dao-ailab/flash-attention
Dao-AILab/flash-attention
24,220Vezi pe GitHubFlashAttention is an attention mechanism optimization library and machine learning acceleration framework designed to increase training speed and reduce memory footprint for large-scale neural network models. It functions as a collection of low-level CUDA kernels that optimize memory-bound operations to improve hardware utilization on graphics processing units. The library distinguishes itself through an input-output-aware algorithm design that minimizes data movement between different levels of memory. By employing kernel fusion and tiled matrix multiplication, it combines sequential operati
Explicitly manages data movement between high-speed on-chip memory and main GPU memory to maximize throughput.
Python
