1 repo
Awesome GitHub RepositoriesContainerized Model Serving
Architectural patterns for serving machine learning models via containers.
Distinguishing note: Focuses on the serving architecture rather than the deployment configuration.
Explore 1 awesome GitHub repository matching devops & infrastructure · Containerized Model Serving. Refine with filters or upvote what's useful.
Awesome Containerized Model Serving GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- TabbyML/tabby
TabbyML/tabby
32,899View on GitHubTabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat capabilities within development environments. By functioning as a private server application, it allows teams to maintain control over their infrastructure and data while integrating intelligent code generation directly into their existing workflows. The platform distinguishes itself through its repository-aware knowledge retrieval and multi-model orchestration. It indexes local and remote source code repositories and technical documentation into a searchable vector-based knowledge gr
Packages inference engines and hardware acceleration drivers into portable images.
Rustaicodegencoding-assistant
