1 مستودع
Awesome GitHub RepositoriesLamport Synchronization Primitive Initializers
Initializes a device buffer to negative zero to set up a Lamport synchronization primitive used in multi-GPU inference.
Distinct from Buffer Initialization Operations: Distinct from Buffer Initialization Operations: specifically sets up a Lamport synchronization primitive, not general buffer filling.
Explore 1 awesome GitHub repository matching data & databases · Lamport Synchronization Primitive Initializers. Refine with filters or upvote what's useful.
Awesome Lamport Synchronization Primitive Initializers GitHub Repositories
اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
- flashinfer-ai/flashinfer
flashinfer-ai/flashinfer
4,996عرض على GitHubFlashInfer is a library of high-performance GPU kernels purpose-built for accelerating large language model inference. It provides optimized implementations for attention operations (including flash attention, page attention, multi-head latent attention, and cascade attention) using paged key-value caches, fused kernel composition, and just-in-time compilation. The library also includes specialized kernels for mixture-of-experts layers, block-scaled low-precision quantization (FP8, FP4), and distributed collective communication. What distinguishes FlashInfer is its fused all-reduce communicat
Initializes device buffers for Lamport synchronization primitives in multi-GPU inference.
Pythonattentioncudadistributed-inference
