For a self-hostable RAG application, the first results are weaviate/verba (Verba is a complete, self-hostable RAG interface and chatbot built on Weaviate, offering document ingestion, hybrid retrieval, LLM orchestration, and a chat/query interface — exactly the category you're looking for), quivrhq/quivr (Quivr is a fully self-hostable RAG platform that handles document ingestion, vector indexing, LLM integration, retrieval, and chat in one package—exactly the complete end-to-end application you're after) and openbmb/ultrarag (UltraRAG is a self-hostable RAG orchestration platform with a visual pipeline builder, document ingestion, vector database integration, LLM support, and a chat interface—covering all the core features needed for a complete RAG application). infiniflow/ragflow and mintplex-labs/anything-llm round out the shortlist. Compare the match explanations and check the project documentation against your requirements.
Deployable open-source frameworks for building and hosting complete retrieval-augmented generation pipelines on your own infrastructure.
Verba is a retrieval-augmented generation interface and chatbot that uses Weaviate to provide factual answers based on private datasets. It functions as a vector database knowledge base, combining a hybrid search engine with an orchestration interface to connect various large language model providers and embedding services. The system differentiates itself through a RAG pipeline manager for adjusting text chunking rules and retrieval settings, alongside a 3D vector space visualization tool for analyzing the spatial organization and clustering of high-dimensional embeddings. It employs a modul
Verba is a complete, self-hostable RAG interface and chatbot built on Weaviate, offering document ingestion, hybrid retrieval, LLM orchestration, and a chat/query interface — exactly the category you're looking for.
Quivr is a retrieval-augmented generation platform designed to transform raw documents into searchable knowledge bases. It functions as a centralized environment where users can ingest files, index them into vector databases, and interact with language models to receive contextually relevant, data-backed responses. The platform distinguishes itself through an agentic workflow orchestrator that sequences retrieval tasks, tool execution, and model interactions to resolve complex, multi-step queries. This engine is entirely configuration-driven, allowing users to define document ingestion, chunk
Quivr is a fully self-hostable RAG platform that handles document ingestion, vector indexing, LLM integration, retrieval, and chat in one package—exactly the complete end-to-end application you're after.
UltraRAG is an LLM RAG orchestration platform and AI agent research framework designed to coordinate complex retrieval-augmented generation workflows. It functions as a multimodal RAG engine capable of retrieving and generating responses using text, images, and diverse data types, while providing tools for vector database management and RAG performance evaluation. The platform features a visual RAG pipeline builder that uses a canvas interface to construct and debug data flows, synchronizing visual designs directly with underlying code. It distinguishes itself through an autonomous research s
UltraRAG is a self-hostable RAG orchestration platform with a visual pipeline builder, document ingestion, vector database integration, LLM support, and a chat interface—covering all the core features needed for a complete RAG application.
This project is a comprehensive retrieval-augmented generation platform designed for building, managing, and deploying knowledge-based AI applications. It provides a unified environment for organizing datasets, configuring conversational chat assistants, and developing autonomous agents that execute multi-step reasoning workflows. By integrating document intelligence with advanced retrieval pipelines, the platform enables the creation of grounded, verifiable responses supported by traceable citations. The platform distinguishes itself through deep document understanding and sophisticated know
RAGFlow is a full-featured, self-hostable RAG platform that handles document ingestion, vector search, LLM integration, and conversational interfaces, exactly matching the requirement for a complete end-to-end application with frontend and backend.
This platform serves as a comprehensive environment for managing private language models, document knowledge bases, and automated agent workflows within secure local infrastructure. It functions as a document-aware workspace that enables users to ingest diverse file formats into searchable repositories, ensuring that all data processing and model inference remain within private, local environments to maintain data sovereignty. The system distinguishes itself through a modular agentic engine that allows for the definition of custom skills and external tool execution. By utilizing a multi-model
anything-llm is a comprehensive, self-hostable RAG workspace that ingests diverse document formats, uses vector databases for retrieval, integrates with local and cloud LLMs, and provides a chat/query interface with workspace-scoped context management — exactly the all-in-one system this search asks for.
This project is a containerized development stack and application framework for building retrieval-augmented generation systems. It provides a dockerized AI sandbox that integrates local model runtimes, knowledge graphs, and vector stores to enable the creation of contextual chatbots. The stack is distinguished by its graph-based vector store, which combines structured knowledge graphs with vector indices for both semantic and structural data retrieval. It allows for local model hosting with CPU or GPU acceleration, enabling generative tasks without reliance on external cloud APIs. The frame
docker/genai-stack is a containerized RAG stack that bundles local LLM runtimes, a graph-augmented vector store, document indexing (including PDFs), and a chat interface into a self-hostable Docker deployment, directly delivering the complete, ready-to-run RAG application you need.
QAnything is a retrieval-augmented generation application framework and self-hosted AI interface. It functions as a system that combines a vector database knowledge base, a document parsing service, and a hybrid search engine to generate answers based on private user data. The project features a modular pipeline architecture that allows users to independently replace components such as parsers, embedding models, and reranking engines. It supports local-first model deployment and offline operation to ensure data privacy, and includes a two-stage retrieval pipeline that merges dense vector embe
QAnything is a self-hosted RAG application framework and AI interface that provides a full pipeline including document parsing, vector database integration, LLM integration, multi-stage retrieval, and a chat interface, making it a comprehensive match for your requirement of a complete self-hostable RAG system.
GPT4All is a cross-platform runtime environment designed to execute large language models directly on local consumer hardware. By leveraging an optimized C++ inference backend, it enables private, offline AI interactions without requiring an internet connection or external cloud services. The project provides a comprehensive ecosystem for managing the entire model lifecycle, including discovery, downloading, and configuration of local weights. What distinguishes the platform is its integrated retrieval-augmented generation engine, which allows users to index local documents into semantic vect
GPT4All is a complete self-hostable application with a local LLM runtime, an integrated RAG engine that indexes documents into semantic vectors, and a chat interface—delivering the full retrieval pipeline, document ingestion, and context management this search requires.
Khoj is a self-hosted artificial intelligence platform designed for personal knowledge management and semantic information retrieval. It functions as a private assistant that indexes your local documents, notes, and external workspaces, allowing you to interact with your data through natural language queries and conversational chat. By maintaining a local-first architecture, the system ensures that your information remains under your control while providing context-aware responses grounded in your personal knowledge base. The platform distinguishes itself through a modular, cross-platform int
Khoj is a complete self-hosted RAG platform that indexes your local documents, powers a conversational chat interface, and integrates with LLMs, giving you exactly the frontend, backend, and document ingestion pipeline this search requires.
Cherry Studio is a cross-platform desktop application that serves as a centralized workspace for managing and interacting with multiple artificial intelligence models. It functions as a local-first orchestrator, prioritizing user privacy by storing all conversation history and knowledge bases directly on your device. By providing a unified interface for both cloud-based and local AI services, the platform simplifies API key management and allows for consistent model interaction across different operating systems. The application distinguishes itself through a robust retrieval-augmented genera
Cherry Studio is a cross-platform desktop application that combines AI model orchestration, local knowledge base management, and a built-in retrieval-augmented generation pipeline, giving you a self-contained self-hostable RAG system with a chat interface and document indexing—all running on your own device.
Bisheng is an enterprise AI framework and LLM DevOps platform designed to manage the full lifecycle of large language models. It provides a unified system for dataset curation, supervised fine-tuning, model versioning, and performance evaluation. The platform features a visual workflow orchestrator for building retrieval-augmented generation pipelines and complex task sequences using flowcharts with conditional logic and human intervention points. It also includes an AI agent framework that uses a specialized guidance language to embed domain expertise and professional business logic into aut
Bisheng is an enterprise AI framework that includes RAG pipeline orchestration, document indexing, and model management, making it a self-hostable RAG system with a visual workflow builder--though its broader LLM DevOps focus means it goes beyond a pure RAG application.
Tabby is a self-hosted AI coding assistant designed to provide real-time code completion and interactive chat capabilities within development environments. By functioning as a private server application, it allows teams to maintain control over their infrastructure and data while integrating intelligent code generation directly into their existing workflows. The platform distinguishes itself through its repository-aware knowledge retrieval and multi-model orchestration. It indexes local and remote source code repositories and technical documentation into a searchable vector-based knowledge gr
Tabby is a self-hosted RAG system that indexes code repositories and technical documentation into a vector store and offers a chat interface for retrieval-augmented code assistance, which matches the category but is specialized for developer workflows rather than general-purpose document ingestion.
This project is a web-based platform designed for retrieval-augmented generation, providing a conversational interface that connects language models to private document collections. It functions as a comprehensive system for managing enterprise knowledge bases, allowing users to query internal documents and receive context-aware, source-verified answers through a natural language chat interface. The platform distinguishes itself by integrating vector-based semantic search with modular knowledge base management, enabling the ingestion, segmentation, and indexing of documents into searchable em
RAG Web UI is a self-hosted intelligent dialogue system built on RAG technology, directly matching the search for a complete RAG application with a chat/query interface, LLM integration, and retrieval pipeline, though the description is concise and does not explicitly detail document ingestion or multi-format document support.
This project is a framework for building custom AI chatbots capable of PDF document analysis. It implements Retrieval Augmented Generation to connect a large language model to private document data. The system utilizes graph-based agent orchestration to control conversation flow and decision logic. It maintains context across interactions through thread-based state management and delivers AI responses to the user interface via real-time streaming. The project covers PDF document ingestion through chunk-based processing and vector-store retrieval. It includes mechanisms for query-based data r
This repository provides a complete self-hosted RAG chatbot for PDF documents with frontend, backend, document ingestion, vector retrieval, and chat interface, directly matching your need for a full‑stack RAG application, though it is specialised for PDFs rather than supporting multiple document formats.
| Repository | Stars | Language | License | Last push |
|---|---|---|---|---|
| weaviate/verba | 7.7K | Python | BSD-3-Clause | |
| quivrhq/quivr | 39.2K | Python | NOASSERTION | |
| openbmb/ultrarag |
| 5.2K |
| Python |
| apache-2.0 |
| infiniflow/ragflow | 82.9K | Python | Apache-2.0 |
| mintplex-labs/anything-llm | 61.7K | JavaScript | MIT |
| docker/genai-stack | 5.3K | Python | CC0-1.0 |
| netease-youdao/qanything | 14K | Python | AGPL-3.0 |
| nomic-ai/gpt4all | 77.4K | C++ | MIT |
| khoj-ai/khoj | 35.2K | Python | AGPL-3.0 |
| cherryhq/cherry-studio | 47.4K | TypeScript | AGPL-3.0 |