1 रिपॉजिटरी
Awesome GitHub RepositoriesDistributed
Mathematical reduction operations performed across multiple distributed devices or nodes.
Distinct from Reductions: Distinct from Reductions: focuses on network-distributed GPU communication rather than local sequence processing.
Explore 1 awesome GitHub repository matching data & databases · Distributed. Refine with filters or upvote what's useful.
Awesome Distributed GitHub Repositories
AI के साथ बेहतरीन रिपॉजिटरी खोजें।हम AI का उपयोग करके सबसे सटीक रिपॉजिटरी खोजेंगे।
- nvidia/nccl
NVIDIA/nccl
4,816GitHub पर देखेंNCCL is a high-performance communication library and distributed GPU computing framework designed for executing collective and point-to-point data exchanges across multiple GPUs in single or multi-node systems. It serves as an RDMA GPU transport layer and memory orchestrator, facilitating high-bandwidth synchronization of data and model gradients for distributed GPU training and inference. The library is distinguished by its ability to execute communication primitives directly from GPU kernels, removing the host CPU from the critical path. It utilizes topology-aware path selection to optimize
NCCL performs a reduction across multiple sources and copies the resulting value to destinations in a single operation.
C++
