How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Fauxpilot is a self-hosted AI coding assistant and local inference server. It functions as a proxy and API gateway that redirects traffic from IDE plugins to a local large language model, allowing for AI-assisted programming without external cloud dependencies.
The main features of fauxpilot/fauxpilot are: Copilot API Emulators, Local Model Inference Servers, OpenAI-Compatible APIs, AI Coding Assistant Proxies, Coding Assistant Protocol Emulation, OpenAI-Compatible, Self-Hosted AI Models, Self-Hosted Coding Assistants.
Projects with overlapping indexed features include: tabbyml/tabby — Tabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat… jundot/omlx — omlx is a local inference server designed to run large language models, vision models, and embedding models on Apple… mlc-ai/mlc-llm — MLC LLM is a machine learning compiler and inference engine designed to execute large language models locally across… nexaai/nexa-sdk — The nexa-sdk is an on-device AI SDK and multimodal inference engine designed to run large language, vision, and audio… go-skynet/localai — LocalAI is a local generative AI platform and inference engine designed to host large language, vision, and audio… coaidev/coai — CoAI is an enterprise-grade, self-hostable AI gateway platform that unifies access to over 200 AI models from more…
Tabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat capabilities within development environments. By functioning as a private server application, it allows teams to maintain control over their infrastructure and data while integrating intelligent code generation directly into their existing workflows. The platform distinguishes itself through its repository-aware knowledge retrieval and multi-model orchestration. It indexes local and remote source code repositories and technical documentation into a searchable vector-based knowledge gr
omlx is a local inference server designed to run large language models, vision models, and embedding models on Apple Silicon. It provides a private alternative to industry-standard AI endpoints by hosting a local API gateway that mirrors OpenAI and Anthropic specifications. The system distinguishes itself through specialized hardware optimizations, including continuous batching for high throughput and a tiered caching system that offloads memory blocks to SSD. It also functions as a Model Context Protocol host, enabling the integration of local models with external tools, agents, and structur
MLC LLM is a machine learning compiler and inference engine designed to execute large language models locally across diverse hardware platforms, including desktop, mobile, and web environments. By utilizing machine learning compilation, the project transforms high-level model definitions into specialized, hardware-specific binary libraries. This process optimizes model weights and generates compute kernels tailored to the unique memory and processing characteristics of target graphics and mobile hardware. The engine distinguishes itself by providing a unified runtime abstraction that enables
LocalAI is a local generative AI platform and inference engine designed to host large language, vision, and audio models on private hardware. It functions as an API compatible gateway that mimics proprietary service endpoints, allowing existing third-party software to integrate with a self-hosted backend. The platform distinguishes itself as a distributed AI model orchestrator, capable of scaling inference across machine clusters using VRAM-aware routing and hardware coordination. It provides a unified interface for diverse open-source backends and supports self-hosted RAG infrastructure thro