1 repositorio
Decentralized networks of GPUs that collectively host model weights and process inference requests.
Distinct from Distributed GPU Computing: Focuses on the peer-to-peer collective hosting and execution model rather than general GPU parallelism strategies.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Collaborative GPU Swarms. Refine with filters or upvote what's useful.
Petals is a decentralized framework and inference engine for running large language models across a peer-to-peer network. It enables the execution of models that exceed the memory of any single machine by splitting computations and model layers across a collaborative swarm of GPUs. The system functions as a collaborative compute network where participants share local GPU resources and host model weights. It supports distributed prompt-tuning to adapt massive models to specific tasks and allows for the establishment of private compute swarms to process sensitive data within restricted, trusted
Establishes a decentralized network of connected devices that collectively host model weights and execute inference.