1 repo
Awesome GitHub RepositoriesParallel Inference Orchestrators
Systems that distribute computational tasks across hardware to optimize inference performance.
Distinguishing note: Focuses on parallelization logic, distinct from general distributed inference.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Parallel Inference Orchestrators. Refine with filters or upvote what's useful.
Awesome Parallel Inference Orchestrators GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- exo-explore/exo
exo-explore/exo
41,615View on GitHubExo is a distributed inference engine designed to run machine learning models across local hardware. It functions as a network orchestration layer that automatically discovers available devices to form a unified computing cluster, allowing users to scale artificial intelligence workloads by distributing computational tasks across multiple machines. The platform distinguishes itself through its ability to manage the entire lifecycle of local models while providing a standardized gateway for external applications. By translating local model outputs into industry-standard formats, it enables exi
Distributes large computational workloads across multiple devices to improve processing speed.
Python
