1 Repo
Techniques for transitioning single-GPU math operations to multi-GPU multi-node execution across thousands of GPUs with minimal code changes.
Distinct from Multi-GPU Deployment: Distinct from Multi-GPU Deployment: focuses on scaling math workloads across nodes, not general deployment strategies.
Explore 1 awesome GitHub repository matching devops & infrastructure · Multi-Node Math Workload Distributions. Refine with filters or upvote what's useful.
Solves distributed 2D and 3D FFTs across multiple machines for exascale problems using MPI-compatible communication.