apache/doris
Doris
Doris is a distributed SQL data warehouse designed for high-performance analytical workloads and real-time data processing. It functions as a unified platform that integrates traditional relational warehousing with lakehouse query capabilities, allowing users to execute analytical operations directly against external data lakes without requiring data migration.
The system distinguishes itself through a shared-nothing, massively parallel processing architecture that utilizes vectorized query execution and columnar storage to maintain sub-second latency. It supports dynamic schema evolution, enabling real-time updates to table structures, and provides elastic resource scaling by decoupling compute and storage layers to accommodate fluctuating workload demands.
Beyond standard analytical processing, the platform incorporates vector database functionality to support artificial intelligence and semantic search applications. It enables hybrid search by combining structured SQL analytics with full-text filtering and vector similarity, facilitating complex retrieval-augmented generation workflows within a single environment. The engine is built to handle high-concurrency requirements, supporting thousands of simultaneous queries per second for enterprise-scale operations.
Features
- Data Warehousing - Handles thousands of simultaneous analytical queries per second for enterprise-scale workloads.
- Distributed Data Warehouses - Provides a scalable distributed data warehouse architecture for managing large-scale analytical workloads with real-time ingestion.
- Real-time Analytics Platforms - Delivers sub-second analytical query performance on massive datasets using a high-concurrency, distributed columnar engine.
- SQL Query Interfaces - Provides a standard ANSI SQL interface for analytical queries and data management.
- Columnar Storage Engines - Organizes data into vertical blocks to minimize disk I/O and accelerate analytical scanning.
- Federated Data Query Engines - Executes federated analytical queries directly against external data lake storage without requiring data migration.
- Real-Time Analytics - Delivers real-time analytics with sub-second latency for operational dashboards and time-sensitive business operations.
- Relational Vector Engines - Unifies relational SQL analytics with vector similarity search to support RAG workflows and intelligent applications.
- Data Lake Acceleration - Enables direct analysis of external data lakes without requiring data migration.
- Real-Time Data Processors - Supports continuous real-time data ingestion to ensure new information is immediately available for analysis.
- Distributed Query Processing - Executes distributed analytical queries across multiple nodes to optimize performance for massive datasets.
- Concurrent Query Processing - Supports high-concurrency analytical query processing, handling thousands of requests per second for enterprise-scale operations.
- Hybrid Search - Combines structured analytics, full-text filtering, and vector similarity search within a single query for advanced data retrieval.
- Parallel Processing - Distributes complex analytical workloads across a cluster of nodes for parallel execution.
- Storage-Compute Architectures - Separates compute and storage layers to enable independent resource scaling based on workload demands.
- Vector Databases - Integrates vector similarity search directly into the database engine to enable semantic analysis alongside structured relational data.
- Vectorized Execution Engines - Processes batches of data rows using CPU-friendly instructions to maximize analytical throughput.
- Shared-Nothing Architectures - Maintains independent node states to eliminate central bottlenecks and ensure linear scalability.
- Knowledge Base Retrieval - Facilitates intelligent document retrieval and context-aware responses by storing and querying enterprise knowledge base data.
- Data Ingestion - Captures and processes incoming information at second-level intervals for immediate availability.
- Schema Evolution - Supports real-time updates to table structures without requiring data migration or system downtime.
- Data Schema Management - Manages dynamic data schemas by supporting semi-structured data and rapid modifications.
- Resource Scaling Strategies - Enables elastic resource scaling by adjusting storage and compute capacity to balance performance requirements.
- Search and Indexing - Combines inverted indexes, bloom filters, and zone maps to prune irrelevant data and accelerate search.
