# TabbyML/tabby **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/tabbyml-tabby).** 32,899 stars · 1,682 forks · Rust · other ## Links - GitHub: https://github.com/TabbyML/tabby - Homepage: https://tabbyml.com - awesome-repositories: https://awesome-repositories.com/repository/tabbyml-tabby.md ## Topics `ai` `codegen` `coding-assistant` `coding-language` `developer-experience` `developer-tools` `gen-ai` `ide` `llms` ## Description Tabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat capabilities within development environments. By functioning as a private server application, it allows teams to maintain control over their infrastructure and data while integrating intelligent code generation directly into their existing workflows. The platform distinguishes itself through its repository-aware knowledge retrieval and multi-model orchestration. It indexes local and remote source code repositories and technical documentation into a searchable vector-based knowledge graph, enabling the assistant to provide context-specific answers and code suggestions. The system manages distinct pipelines for completion, chat, and embedding models, allowing users to tune performance and hardware utilization based on specific task requirements. The architecture supports scalable, containerized deployment, enabling consistent performance across local and cloud environments. It utilizes declarative configuration to manage infrastructure and service replicas, while integrating with development environments through standard messaging interfaces. Users can configure specific models for different tasks, ensuring compatibility with performance benchmarks and hardware constraints. ## Tags ### Artificial Intelligence & ML - [Code Completion Assistants](https://awesome-repositories.com/f/artificial-intelligence-ml/code-completion-assistants.md) — Generates intelligent, context-aware code suggestions and multi-line completions directly within the editor. - [Code Generation Assistants](https://awesome-repositories.com/f/artificial-intelligence-ml/code-generation-assistants.md) — Generates intelligent code suggestions directly within the editor to accelerate development workflows. ([source](https://tabby.tabbyml.com/)) - [Self-Hosted Coding Assistants](https://awesome-repositories.com/f/artificial-intelligence-ml/self-hosted-coding-assistants.md) — Provides real-time code completion and conversational assistance by indexing local and remote project repositories. - [Conversational Coding Assistants](https://awesome-repositories.com/f/artificial-intelligence-ml/conversational-coding-assistants.md) — Provides an interactive chat interface that answers technical questions and explains codebase-specific logic. - [Coding Question Answering Systems](https://awesome-repositories.com/f/artificial-intelligence-ml/coding-question-answering-systems.md) — Provides instant responses to technical questions directly inside the development environment. ([source](https://tabby.tabbyml.com/)) - [Context-Aware Code Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/context-aware-code-generators.md) — Produces intelligent code suggestions and answers by analyzing codebase structure, commit history, and documentation. - [Inference Orchestration Systems](https://awesome-repositories.com/f/artificial-intelligence-ml/inference-orchestration-systems.md) — Manages distinct pipelines for completion, chat, and embedding models to optimize resource usage. - [Retrieval Augmented Generation Systems](https://awesome-repositories.com/f/artificial-intelligence-ml/retrieval-augmented-generation-systems.md) — Indexes external codebases and documentation to enable semantic search and provide deep project-specific context. - [Developer Knowledge Bases](https://awesome-repositories.com/f/artificial-intelligence-ml/developer-knowledge-bases.md) — Connects technical documentation and source code to provide accurate answers directly inside the editor. - [Technical Documentation Retrieval](https://awesome-repositories.com/f/artificial-intelligence-ml/technical-documentation-retrieval.md) — Retrieves technical knowledge to provide instant answers to documentation queries. ([source](https://tabbyml.github.io/tabby)) - [Chat Model Configurations](https://awesome-repositories.com/f/artificial-intelligence-ml/chat-model-configurations.md) — Allows chat model configuration to select optimized models for conversational tasks. ([source](https://tabby.tabbyml.com/docs/models/)) - [Completion Model Configurations](https://awesome-repositories.com/f/artificial-intelligence-ml/completion-model-configurations.md) — Allows completion model configuration to select code completion models based on hardware capabilities. ([source](https://tabby.tabbyml.com/docs/models/)) - [Inference Engines](https://awesome-repositories.com/f/artificial-intelligence-ml/inference-engines.md) — Provides a deployable service that manages hardware-accelerated model execution for code generation. - [Vector Search Engines](https://awesome-repositories.com/f/artificial-intelligence-ml/vector-search-engines.md) — Indexes code and documentation into a vector store to provide relevant context for model inference. ### Development Tools & Productivity - [Real-time Code Autocompletes](https://awesome-repositories.com/f/development-tools-productivity/real-time-code-autocompletes.md) — Provides real-time code autocomplete to suggest multi-line completions as you type. ([source](https://tabby.tabbyml.com/docs/extensions/)) ### Programming Languages & Runtimes - [Language Server Protocol Integrations](https://awesome-repositories.com/f/programming-languages-runtimes/language-server-protocol-integrations.md) — Communicates with development environments through standard messaging interfaces to deliver code suggestions. ### User Interface & Experience - [Interactive Chat Interfaces](https://awesome-repositories.com/f/user-interface-experience/interactive-chat-interfaces.md) — Features an interactive chat interface to answer coding questions and perform inline edits. ([source](https://tabby.tabbyml.com/docs/extensions)) ### Data & Databases - [Code Indexing Engines](https://awesome-repositories.com/f/data-databases/code-indexing-engines.md) — Indexes source code repositories to improve model inference and understanding of code. ([source](https://tabby.tabbyml.com/docs/configuration)) - [Repository Indexing Pipelines](https://awesome-repositories.com/f/data-databases/repository-indexing-pipelines.md) — Crawls and processes source code repositories to build a searchable knowledge graph. ### DevOps & Infrastructure - [Containerized Model Serving](https://awesome-repositories.com/f/devops-infrastructure/containerized-model-serving.md) — Packages inference engines and hardware acceleration drivers into portable images. - [Containerized Service Deployments](https://awesome-repositories.com/f/devops-infrastructure/containerized-service-deployments.md) — Supports containerized service deployment using images that enable hardware acceleration. ([source](https://tabby.tabbyml.com/docs/installation/)) - [Self-Hosted AI Infrastructure](https://awesome-repositories.com/f/devops-infrastructure/self-hosted-ai-infrastructure.md) — Deploys and manages private, containerized machine learning models on internal hardware to ensure data privacy. - [Model Serving Platforms](https://awesome-repositories.com/f/devops-infrastructure/model-serving-platforms.md) — Manages service replicas and hardware-accelerated infrastructure to handle high-demand coding assistance tasks. - [Cloud Deployment Configurations](https://awesome-repositories.com/f/devops-infrastructure/cloud-deployment-configurations.md) — Provides cloud deployment configuration to specify hardware requirements and startup commands. ([source](https://tabby.tabbyml.com/docs/installation/skypilot/)) ### Software Engineering & Architecture - [Declarative Configuration Management](https://awesome-repositories.com/f/software-engineering-architecture/declarative-configuration-management.md) — Uses structured files to define infrastructure requirements and service parameters.