# openbmb/ultrarag

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/openbmb-ultrarag).**

5,220 stars · 367 forks · Python · apache-2.0

## Links

- GitHub: https://github.com/OpenBMB/UltraRAG
- Homepage: https://ultrarag.github.io/
- awesome-repositories: https://awesome-repositories.com/repository/openbmb-ultrarag.md

## Topics

`deepseek` `demo` `easy` `embedding` `flask` `gpt` `huggingface-transformers` `llm` `mcp` `multimodal` `openai` `qwen` `rag` `sentence-transformers` `ui` `vllm` `vlm`

## Description

UltraRAG is an LLM RAG orchestration platform and AI agent research framework designed to coordinate complex retrieval-augmented generation workflows. It functions as a multimodal RAG engine capable of retrieving and generating responses using text, images, and diverse data types, while providing tools for vector database management and RAG performance evaluation.

The platform features a visual RAG pipeline builder that uses a canvas interface to construct and debug data flows, synchronizing visual designs directly with underlying code. It distinguishes itself through an autonomous research system that employs state-machine logic to route tasks between information gathering, planning, and writing to produce long-form research reports.

The system covers a broad range of capabilities, including multimodal knowledge base management, real-time reasoning chain visualization, and the execution of complex workflows with loops and conditional branching. It also supports the integration of decoupled atomic servers for extensibility and provides toolkits for benchmarking model output quality against standardized datasets.

The software can be deployed using Docker containers for standardized environments or as local research agents for offline operation.

## Tags

### Artificial Intelligence & ML

- [RAG Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/language-model-orchestration/retrieval-augmented-generation/rag-pipelines.md) — Provides a platform for designing complex RAG pipelines with modular components and retrieval workflows.
- [Knowledge Base Retrieval](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-rag-development/knowledge-base-retrieval.md) — Allows users to answer questions by mounting specific knowledge bases and selecting pre-configured retrieval pipelines. ([source](https://ultrarag.openbmb.cn/pages/en/ui/start))
- [Agentic RAG Platforms](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-rag-platforms.md) — Integrates reasoning agents and RAG into a comprehensive platform for complex data fetching and generation.
- [Autonomous Research Agents](https://awesome-repositories.com/f/artificial-intelligence-ml/autonomous-research-agents.md) — Implements autonomous agents that perform multi-step research through recursive gathering and synthesis of findings.
- [Knowledge Base Management](https://awesome-repositories.com/f/artificial-intelligence-ml/knowledge-base-management.md) — Handles the full lifecycle of document ingestion, including uploading, chunking, and embedding management. ([source](https://cdn.jsdelivr.net/gh/openbmb/ultrarag@main/README.md))
- [Long-Form Text Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/long-form-text-generation.md) — Conducts autonomous retrieval and reasoning loops to produce comprehensive long-form research reports. ([source](https://ultrarag.openbmb.cn/pages/en/demo/deepresearch))
- [Multimodal RAG](https://awesome-repositories.com/f/artificial-intelligence-ml/multimodal-rag.md) — Retrieves and generates responses using a combination of diverse data types to provide rich context. ([source](https://ultrarag.openbmb.cn/pages/en/getting_started/update))
- [Multimodal Retrieval Systems](https://awesome-repositories.com/f/artificial-intelligence-ml/multimodal-retrieval-systems.md) — Implements a system for cross-modal data searching by mapping text and images into shared vector spaces.
- [Multimodal RAG](https://awesome-repositories.com/f/artificial-intelligence-ml/rag-implementations/multimodal-rag.md) — Builds retrieval systems that combine text and images to provide rich context for AI responses.
- [Research Agent Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/research-agent-frameworks.md) — Provides a specialized framework for autonomous agents to perform iterative research and long-form synthesis.
- [Vector Databases](https://awesome-repositories.com/f/artificial-intelligence-ml/vector-databases.md) — Manages the ingestion, chunking, and embedding of multimodal documents into high-dimensional stores for semantic retrieval.
- [Visual AI Workflow Builders](https://awesome-repositories.com/f/artificial-intelligence-ml/visual-ai-workflow-builders.md) — Offers a visual canvas interface for constructing and debugging AI data pipelines.
- [Workflow Orchestration](https://awesome-repositories.com/f/artificial-intelligence-ml/workflow-orchestration.md) — Designs complex retrieval logic using control structures like loops and conditional branches defined in configuration. ([source](https://cdn.jsdelivr.net/gh/openbmb/ultrarag@main/README.md))
- [Local Agent Deployments](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-deployment/local-agent-deployments.md) — Runs AI research agents on local hardware to ensure data privacy and offline operation. ([source](https://ultrarag.openbmb.cn/pages/en/demo/deepresearch))
- [Reasoning Traceability](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-reasoning-loops/reasoning-traceability.md) — Streams inputs and outputs of every pipeline stage to visualize and audit the full reasoning chain.
- [Document Indexing](https://awesome-repositories.com/f/artificial-intelligence-ml/document-indexing.md) — Converts natural language text into vector representations and organizes them into a searchable index for RAG. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/00_Installing_and_Running_RAG.md))
- [Natural Language Pipeline Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/natural-language-pipeline-generation.md) — Updates workflow architecture and backend parameters using natural language instructions instead of manual edits. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/ultrarag3_0.md))
- [Prompt Templates](https://awesome-repositories.com/f/artificial-intelligence-ml/prompt-templates.md) — Provides an online interface to create, edit, and apply reusable prompt structures to active pipelines. ([source](https://ultrarag.openbmb.cn/pages/en/ui/start))
- [RAG Evaluation Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/rag-evaluation-frameworks.md) — Includes frameworks for assessing RAG performance using metrics like groundedness and retrieval relevance.
- [Custom Data and Tool Servers](https://awesome-repositories.com/f/artificial-intelligence-ml/tool-integration-servers/custom-data-and-tool-servers.md) — Implements independent servers that expose custom search tools and code functions for use across different RAG pipelines.
- [Web Search Integrations](https://awesome-repositories.com/f/artificial-intelligence-ml/web-search-integrations.md) — Connects processing pipelines to external search tools to gather real-time information based on generated sub-questions. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/01_build_light_deepresearch.md))

### User Interface & Experience

- [Visual Pipeline Builders](https://awesome-repositories.com/f/user-interface-experience/visual-pipeline-builders.md) — Provides a canvas-based interface to construct and debug data flows with real-time synchronization to code. ([source](https://cdn.jsdelivr.net/gh/openbmb/ultrarag@main/README.md))
- [Interactive AI Demos](https://awesome-repositories.com/f/user-interface-experience/interactive-ai-demos.md) — Transforms pipeline configurations into a functional user interface featuring synchronized canvas and code editors. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/ultrarag3_0.md))

### Development Tools & Productivity

- [Visual-to-Code Sync Engines](https://awesome-repositories.com/f/development-tools-productivity/visual-to-code-sync-engines.md) — Provides a canvas interface that synchronizes visual workflow designs directly with underlying configuration files.
- [Multi-Format Document Parsing](https://awesome-repositories.com/f/development-tools-productivity/file-indexing-utilities/multi-format-document-parsing.md) — Processes raw files into structured formats to build a knowledge base for retrieval. ([source](https://ultrarag.openbmb.cn/pages/en/getting_started/update))
- [Logic Prototypes](https://awesome-repositories.com/f/development-tools-productivity/interactive-prototyping/code-prototyping/logic-prototypes.md) — Converts pipeline logic into an interactive conversational web interface for rapid debugging. ([source](https://cdn.jsdelivr.net/gh/openbmb/ultrarag@main/README.md))

### Education & Learning Resources

- [Agentic Research Loops](https://awesome-repositories.com/f/education-learning-resources/research-workflow-automation/agentic-research-loops.md) — Manages a state-machine loop that routes tasks between gathering, planning, and writing to produce long-form reports. ([source](https://ultrarag.openbmb.cn/pages/en/demo/deepresearch))

### Software Engineering & Architecture

- [RAG Component Modularity](https://awesome-repositories.com/f/software-engineering-architecture/modular-feature-architectures/rag-component-modularity.md) — Implements retrieval, encoding, and generation as independent services that can be invoked individually or in sequence.
- [State Machine Orchestrators](https://awesome-repositories.com/f/software-engineering-architecture/state-machine-orchestrators.md) — Uses state-machine logic to orchestrate complex research tasks, routing data between planning, gathering, and writing stages.
- [RAG Step Modularization](https://awesome-repositories.com/f/software-engineering-architecture/application-lifecycle-management/configuration-management/automation-and-templating-frameworks/configuration-modularization/rag-step-modularization.md) — Defines the sequence of data loading, retrieval, and generation steps through modular configuration files. ([source](https://ultrarag.openbmb.cn/pages/en/getting_started/quick_start))
- [YAML Configuration Files](https://awesome-repositories.com/f/software-engineering-architecture/application-lifecycle-management/configuration-management/configuration-formats-and-schemas/yaml-configuration-files.md) — Uses structured YAML configuration files to define the sequence of retrieval and generation steps.
- [Configuration Workflows](https://awesome-repositories.com/f/software-engineering-architecture/configuration-workflows.md) — Defines complex processing logic including loops and conditional branching via structured configuration files. ([source](https://ultrarag.openbmb.cn/pages/en/getting_started/introduction))
- [Pipeline Parameter Configurators](https://awesome-repositories.com/f/software-engineering-architecture/default-configuration-values/execution-parameter-configurations/application-parameter-configurators/pipeline-parameter-configurators.md) — Manages model settings, API keys, and prompt templates via dedicated parameter files to customize pipeline behavior. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/01_build_light_deepresearch.md))
- [Inference Pipeline Definitions](https://awesome-repositories.com/f/software-engineering-architecture/default-configuration-values/execution-parameter-configurations/application-parameter-configurators/pipeline-parameter-configurators/pipeline-definition-templating/inference-pipeline-definitions.md) — Implements the execution order and business logic of generation processes using YAML configuration files. ([source](https://ultrarag.openbmb.cn/pages/en/getting_started/introduction))

### Part of an Awesome List

- [Multimodal Corpora Integration](https://awesome-repositories.com/f/awesome-lists/data/datasets-and-corpora/multimodal-corpora-integration.md) — Integrates text and image datasets to build and test retrieval systems across multiple modalities. ([source](https://ultrarag.openbmb.cn/pages/en/develop_guide/dataset))
- [RAG and Data Pipelines](https://awesome-repositories.com/f/awesome-lists/ai/rag-and-data-pipelines.md) — Low-code framework for building complex RAG pipelines.

### Data & Databases

- [Vector Database Integrations](https://awesome-repositories.com/f/data-databases/vector-database-integrations.md) — Connects to external indexing stores to manage and retrieve high-dimensional vector data. ([source](https://ultrarag.openbmb.cn/pages/en/getting_started/update))
- [Vector Database Management Tools](https://awesome-repositories.com/f/data-databases/vector-databases/vector-database-management-tools.md) — Provides tools for managing document ingestion, chunking, and embeddings within vector storage.

### DevOps & Infrastructure

- [Model Inference Deployment](https://awesome-repositories.com/f/devops-infrastructure/deployment-management/model-inference-deployment.md) — Deploys language and embedding models using standardized API protocols via containerized or host-based setups. ([source](https://ultrarag.openbmb.cn/pages/en/ui/prepare))

### System Administration & Monitoring

- [Pipeline Performance Evaluators](https://awesome-repositories.com/f/system-administration-monitoring/monitoring-and-observability/observability-platforms/metric-performance-monitors/pipeline-performance-evaluators.md) — Measures the quality of retrieval and generation components against reference datasets. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/00_Installing_and_Running_RAG.md))
- [Pipeline Execution Visualizers](https://awesome-repositories.com/f/system-administration-monitoring/pipeline-execution-visualizers.md) — Displays the inputs and outputs of processing stages to visualize the AI reasoning chain. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/01_build_light_deepresearch.md))
- [Reasoning Chain Visualizers](https://awesome-repositories.com/f/system-administration-monitoring/reasoning-chain-visualizers.md) — Streams intermediate states and tool invocations in real time to debug the generation process. ([source](https://github.com/OpenBMB/UltraRAG/blob/page/project/blog/en/ultrarag3_0.md))

### Testing & Quality Assurance

- [RAG Performance Benchmarks](https://awesome-repositories.com/f/testing-quality-assurance/rag-performance-benchmarks.md) — Runs standardized evaluation workflows against research benchmarks to quantify retrieval accuracy. ([source](https://cdn.jsdelivr.net/gh/openbmb/ultrarag@main/README.md))