# promtengineer/localgpt

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/promtengineer-localgpt).**

22,215 stars · 2,483 forks · Python · MIT

## Links

- GitHub: https://github.com/PromtEngineer/localGPT
- awesome-repositories: https://awesome-repositories.com/repository/promtengineer-localgpt.md

## Description

localGPT is a private AI knowledge base and retrieval-augmented generation application. It provides a local document indexer, a hybrid search engine, and an inference interface to enable chatting with private documents and managing a self-hosted information repository without sending data to external servers.

The system distinguishes itself through a dual-pass verification pipeline that ensures generated answers are grounded in retrieved sources, accompanied by explicit source attribution. It employs a hybrid retrieval approach combining semantic vector search with keyword matching and reranking, and utilizes recursive query decomposition to break complex requests into smaller parallel sub-queries.

The platform covers broad capability areas including multi-format document processing, dynamic query routing, and semantic query caching. It also manages conversation history tracking and provides a RESTful API for integrating document retrieval and language model functionality into external applications.

The project integrates with open-source models across different hardware accelerators and includes system health monitoring via structured logs and health endpoints.

## Tags

### Artificial Intelligence & ML

- [Local RAG Implementations](https://awesome-repositories.com/f/artificial-intelligence-ml/local-rag-implementations.md) — Provides a complete local system for chatting with private documents using retrieval-augmented generation and local language models.
- [Retrieval-Augmented Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/retrieval-augmented-generation.md) — Combines local document retrieval with a large language model to generate grounded responses using private context.
- [Retrieval-Augmented Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/conversational-interfaces/retrieval-augmented-generation.md) — Implements a local retrieval-augmented generation pipeline to improve AI response accuracy using private documents.
- [Documentation Query Interfaces](https://awesome-repositories.com/f/artificial-intelligence-ml/documentation-query-interfaces.md) — Enables answering natural language questions using indexed document collections with integrated source citations. ([source](https://github.com/promtengineer/localgpt#readme))
- [Hybrid Search Systems](https://awesome-repositories.com/f/artificial-intelligence-ml/hybrid-search-systems.md) — Combines semantic vector search with keyword-based search and reranking to improve retrieval accuracy. ([source](https://github.com/promtengineer/localgpt#readme))
- [Local Model Execution](https://awesome-repositories.com/f/artificial-intelligence-ml/local-model-execution.md) — Executes embedding and text generation models directly on local hardware to ensure data privacy.
- [Private Document Retrieval](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-deployment-and-serving/knowledge-retrieval-and-documents/private-document-retrieval.md) — Enables querying private files and documents using local language models without external data exposure.
- [Indexing Context Enrichment](https://awesome-repositories.com/f/artificial-intelligence-ml/document-indexing/indexing-context-enrichment.md) — Adds supplemental information to documents during indexing to enhance the model's understanding of the content. ([source](https://github.com/promtengineer/localgpt#readme))
- [Grounded Answer Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/generative-ai/grounded-answer-generation.md) — Ensures generated responses are supported by traceable citations and source verification from retrieved documents. ([source](https://github.com/promtengineer/localgpt#readme))
- [Groundedness Verifications](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/generative-ai/grounded-answer-generation/answer-accuracy-evaluators/groundedness-verifications.md) — Performs an independent verification pass to ensure generated responses match the retrieved document context. ([source](https://github.com/promtengineer/localgpt#readme))
- [AI Model Integrations](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-inference-serving/model-integration-pipelines/ai-model-integrations.md) — Includes adapters and interfaces to connect various open-source models for inference and embeddings across different hardware. ([source](https://github.com/promtengineer/localgpt#readme))
- [Query Routers](https://awesome-repositories.com/f/artificial-intelligence-ml/query-routers.md) — Directs user inputs to either a direct model response or a retrieval pipeline based on request complexity.
- [Semantic Chunking](https://awesome-repositories.com/f/artificial-intelligence-ml/semantic-chunking.md) — Implements semantic chunking to split documents into meaningful segments that fit within model context windows.
- [Late Chunking](https://awesome-repositories.com/f/artificial-intelligence-ml/semantic-chunking/late-chunking.md) — Implements late chunking to maintain the semantic meaning of data by splitting text after embedding. ([source](https://github.com/promtengineer/localgpt#readme))
- [Recursive Decomposers](https://awesome-repositories.com/f/artificial-intelligence-ml/task-decompositions/recursive-decomposers.md) — Breaks complex natural language requests into smaller sub-queries for parallel execution and final synthesis.

### Part of an Awesome List

- [Local AI Search](https://awesome-repositories.com/f/awesome-lists/ai/local-ai-search.md) — Uses a hybrid search engine and smart router to summarize information found within local files. ([source](https://github.com/promtengineer/localgpt#readme))
- [Model Deployment and Platforms](https://awesome-repositories.com/f/awesome-lists/ai/model-deployment-and-platforms.md) — Fully private, on-premise document intelligence platform for chatting with your documents using local LLMs.
- [Data Interaction & Memory](https://awesome-repositories.com/f/awesome-lists/data/data-interaction-memory.md) — Private, local document interaction using vector databases and LLMs.

### Data & Databases

- [Local Document Indexing](https://awesome-repositories.com/f/data-databases/data-integration-synchronization/local-document-indexing.md) — Processes uploaded files into a searchable local collection for retrieval-augmented generation. ([source](https://github.com/promtengineer/localgpt#readme))
- [Hybrid Search Engines](https://awesome-repositories.com/f/data-databases/hybrid-search-engines.md) — Integrates vector-based semantic retrieval with traditional keyword-based indexing to improve document discovery precision.
- [Local Knowledge Bases](https://awesome-repositories.com/f/data-databases/local-knowledge-bases.md) — Parses, indexes, and manages local document collections for private information retrieval and answer extraction.
- [Multi-Format Document Ingestion](https://awesome-repositories.com/f/data-databases/multi-format-document-ingestion.md) — Ingests various file types and applies generated context to improve the retrieval of relevant information. ([source](https://github.com/promtengineer/localgpt#readme))
- [Recursive Query Decomposition](https://awesome-repositories.com/f/data-databases/query-processing/complex-query-processors/recursive-query-decomposition.md) — Breaks complex user requests into multiple sub-queries executed in parallel to synthesize a final comprehensive answer. ([source](https://github.com/promtengineer/localgpt#readme))
- [Semantic Search Engines](https://awesome-repositories.com/f/data-databases/search-indexing-technologies/search-indexing/search-information-retrieval/semantic-search-engines.md) — Utilizes vector embeddings and keyword search to retrieve information from large sets of files based on conceptual meaning.

### DevOps & Infrastructure

- [Response Grounding Verifications](https://awesome-repositories.com/f/devops-infrastructure/continuous-integration/quality-gates/ai-generation-verifications/response-grounding-verifications.md) — Employs a dual-pass verification pipeline to ensure generated answers are strictly grounded in retrieved sources.

### User Interface & Experience

- [Source Attribution Interfaces](https://awesome-repositories.com/f/user-interface-experience/source-attribution-interfaces.md) — Provides UI components that list document references for every response to verify the origin of information. ([source](https://github.com/promtengineer/localgpt#readme))