1 repo
Software suites providing fundamental building blocks for implementing data-parallel and model-parallel training.
Explore 1 awesome GitHub repository matching networking & communication · Distributed Training Primitives. Refine with filters or upvote what's useful.
PyTorch is a machine learning framework centered on a GPU-ready tensor library that supports multi-dimensional array operations across both CPU and accelerator hardware. It provides a foundational infrastructure for mathematical computation and dynamic neural network construction, utilizing a tape-based automatic diffe