1 repo
Awesome GitHub RepositoriesModel Serving Platforms
Infrastructure for deploying, scaling, and managing machine learning model inference services.
Distinguishing note: Focuses on the operational deployment and scaling of models, distinct from the model development process.
Explore 1 awesome GitHub repository matching devops & infrastructure · Model Serving Platforms. Refine with filters or upvote what's useful.
Awesome Model Serving Platforms GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- TabbyML/tabby
TabbyML/tabby
32,899View on GitHubTabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat capabilities within development environments. By functioning as a private server application, it allows teams to maintain control over their infrastructure and data while integrating intelligent code generation directly into their existing workflows. The platform distinguishes itself through its repository-aware knowledge retrieval and multi-model orchestration. It indexes local and remote source code repositories and technical documentation into a searchable vector-based knowledge gr
Manages service replicas and hardware-accelerated infrastructure to handle high-demand coding assistance tasks.
Rustaicodegencoding-assistant
