1 repo
Awesome GitHub RepositoriesInference Orchestration Systems
Systems that manage and route requests across multiple machine learning models.
Distinguishing note: Focuses on the orchestration logic for multi-model setups.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Inference Orchestration Systems. Refine with filters or upvote what's useful.
Awesome Inference Orchestration Systems GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- TabbyML/tabby
TabbyML/tabby
32,899View on GitHubTabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat capabilities within development environments. By functioning as a private server application, it allows teams to maintain control over their infrastructure and data while integrating intelligent code generation directly into their existing workflows. The platform distinguishes itself through its repository-aware knowledge retrieval and multi-model orchestration. It indexes local and remote source code repositories and technical documentation into a searchable vector-based knowledge gr
Manages distinct pipelines for completion, chat, and embedding models to optimize resource usage.
Rustaicodegencoding-assistant
