1 مستودع
Mechanisms for copying tensors or values from a single source process to all other participating processes in a distributed cluster.
Distinct from Broadcast Joins: Closest candidates focus on database joins or process monitoring, not the tensor-level broadcasting required for ML distributed training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Process Data Broadcasting. Refine with filters or upvote what's useful.
Ignite is a high-level training framework for PyTorch neural networks that serves as a training engine and deep learning lifecycle manager. It provides a structured system for organizing and automating training and evaluation loops, managing data iterators and triggering event handlers at specific milestones during the model training process. The project distinguishes itself through a comprehensive suite of tools for distributed training and model evaluation. It includes utilities for synchronizing gradients and coordinating collective communication across multiple GPUs or nodes, as well as a
Implements utilities for broadcasting specific values or tensors from one source process to all others in a cluster.