For an analytics database for slicing huge tables fast, the first results are apache/doris (Apache Doris is a distributed SQL data warehouse that features columnar storage, vectorized query execution, and real-time data processing, making it well-suited for high-performance OLAP workloads), starrocks/starrocks (StarRocks is a distributed SQL OLAP database engine featuring columnar storage, vectorized execution, and real-time data ingestion, which directly matches your search for a high-performance analytical database) and questdb/questdb (QuestDB is a high-performance time-series database featuring columnar storage, SQL support, and real-time ingestion, making it a strong fit for analytical processing despite its specific focus on time-series data). cwida/duckdb and druid-io/druid round out the shortlist. Compare the match explanations and check the project documentation against your requirements.
High-performance open-source database systems optimized for rapid analytical processing and complex large-scale data queries.
Doris is a distributed SQL data warehouse designed for high-performance analytical workloads and real-time data processing. It functions as a unified platform that integrates traditional relational warehousing with lakehouse query capabilities, allowing users to execute analytical operations directly against external data lakes without requiring data migration. The system distinguishes itself through a shared-nothing, massively parallel processing architecture that utilizes vectorized query execution and columnar storage to maintain sub-second latency. It supports dynamic schema evolution, en
Apache Doris is a distributed SQL data warehouse that features columnar storage, vectorized query execution, and real-time data processing, making it well-suited for high-performance OLAP workloads.
StarRocks is a distributed SQL OLAP database engine designed for real-time analytics and high-performance multi-dimensional analysis. It functions as a data lakehouse query engine that enables SQL execution across large datasets and external open table formats without requiring local data imports. The system employs a shared-nothing distributed architecture and utilizes the MySQL protocol to integrate with business intelligence tools. It maintains real-time data consistency through a primary key upsert model and accelerates query response times using vectorized execution and cost-based optimi
StarRocks is a distributed SQL OLAP database engine featuring columnar storage, vectorized execution, and real-time data ingestion, which directly matches your search for a high-performance analytical database.
QuestDB is a high-performance, distributed time-series database designed for the ingestion, storage, and analysis of massive datasets. It functions as a real-time analytics platform that utilizes a columnar storage engine to optimize disk input and output, enabling efficient analytical scans and complex windowing operations on streaming data. The platform distinguishes itself through specialized capabilities for handling asynchronous time-series streams, including advanced join algorithms that align disparate data sets based on precise timestamp lookups. It supports high-volume ingestion thro
QuestDB is a high-performance time-series database featuring columnar storage, SQL support, and real-time ingestion, making it a strong fit for analytical processing despite its specific focus on time-series data.
DuckDB is an embedded, in-process analytical SQL database and OLAP database management system. It functions as a data engine for Parquet and CSV files, allowing users to execute complex SQL queries on large datasets without requiring a separate server process. The system is designed for local analytical processing and embedded data science workflows. It enables the direct querying and analysis of Parquet and CSV files from disk, bypassing the need to load data into a permanent database. The engine provides high-performance analytical SQL execution, including support for window functions and
DuckDB is an in-process columnar analytical database built for high-performance SQL queries on local datasets, though it lacks the distributed architecture typically required for large-scale clustered deployments.
Druid is a distributed columnar store and online analytical processing database designed for real-time analytics. It functions as a SQL analytics platform and a streaming data ingestion engine, allowing for the analysis of large datasets with low latency to support interactive dashboards and high-concurrency operational workloads. The system integrates a streaming data ingestion engine that loads information via batch or streaming processes to enable immediate analysis of arriving data. It provides high-performance analytical processing to execute slice-and-dice queries on massive data volume
Druid is a distributed columnar OLAP database built for real-time data ingestion, SQL analytics, and high-performance querying on massive datasets.
ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through ad
ClickHouse is a columnar OLAP database built for real-time analytics, large-scale data aggregation, and distributed high-throughput processing with full SQL support and compression.
Apache Druid is a real-time analytics database and distributed columnar time-series store designed for sub-second analytical queries. It functions as a data platform featuring a distributed SQL query engine and a real-time data ingestion system for moving historical and streaming data from external sources. The system is distinguished by its ability to provide low-latency analytics under high concurrency to power operational dashboards. It implements a Kerberos-secured environment for user authentication and employs a shared-nothing cluster architecture to enable horizontal scaling. The plat
Apache Druid is a distributed columnar OLAP database featuring real-time data ingestion, SQL support, and low-latency analytical querying designed for high-concurrency workloads.
OceanBase is a distributed SQL database designed for high availability and strong consistency across multiple nodes and regions. It functions as a hybrid transactional and analytical processing engine, allowing real-time analytics and transactions to execute on a single data copy. The system also serves as a vector database engine for indexing and querying vector data to power semantic search and recommendation systems. The platform features native compatibility layers for MySQL and Oracle, enabling the migration of legacy workloads without rewriting SQL code. It utilizes a Paxos-based distri
OceanBase is a distributed hybrid transactional and analytical database that supports real-time analytics and SQL queries, though it is primarily designed as an HTAP system rather than a pure columnar OLAP database.
DuckDB is an in-process analytical database engine designed to run directly within an application process. As a zero-dependency, embedded system, it provides enterprise-grade SQL data processing capabilities without the overhead of managing a dedicated database server. It is built to handle complex analytical and aggregation tasks by storing and retrieving information in columns, allowing for high-performance relational data manipulation. The engine distinguishes itself through a columnar vectorized execution model that maximizes CPU cache efficiency during query operations. It employs adapti
DuckDB provides high-performance columnar storage and vectorized execution for analytical processing, but it is an in-process embedded engine rather than a distributed architecture.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Pinot is a distributed, columnar analytical database purpose-built for low-latency, high-concurrency online analytical processing on real-time and batch ingestion streams.
Apache Druid is a real-time OLAP database and distributed analytics engine. It functions as a columnar time-series database designed for high-performance analytical queries and the real-time ingestion of streaming and batch datasets. The system provides a framework for high-concurrency analytics, allowing multiple simultaneous users to execute SQL and native queries across large-scale data. It supports mixed data ingestion, combining real-time streaming and batch loading into a single system for unified analysis. The platform includes capabilities for distributed cluster management, enabling
Apache Druid is a distributed columnar OLAP database built for real-time analytics, high-performance SQL queries, and streaming data ingestion.
TiDB is a horizontally scalable, distributed SQL database designed to provide consistent transactional storage and high-performance analytical processing within a single unified architecture. It utilizes a decoupled compute-storage design and a distributed key-value storage layer to ensure horizontal scalability and efficient range-based queries. By employing a consensus-based replication algorithm, the system maintains high availability and automatic failover across multiple nodes and geographical regions. The platform distinguishes itself through its hybrid transactional and analytical proc
TiDB is a distributed NewSQL database that combines transactional storage with hybrid analytical processing capabilities, making it a viable fit for analytical workloads despite not being a pure columnar store.
GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without
GreptimeDB is a distributed time-series and observability database featuring a columnar storage engine and SQL support, making it well-suited for analytical processing despite its primary focus on monitoring workloads.
| Repository | Stars | Language | License | Last push |
|---|---|---|---|---|
| apache/doris | 15.5K | Java | Apache-2.0 | |
| starrocks/starrocks | 11.8K | Java | Apache-2.0 | |
| questdb/questdb |
| 17.1K |
| Java |
| Apache-2.0 |
| cwida/duckdb | 38.8K | C++ | MIT |
| druid-io/druid | 14K | Java | Apache-2.0 |
| clickhouse/clickhouse | 48.2K | C++ | Apache-2.0 |
| apache/druid | 14K | Java | Apache-2.0 |
| oceanbase/oceanbase | 10K | C++ | other |
| duckdb/duckdb | 38.8K | C++ | MIT |
| apache/pinot | 6.1K | Java | Apache-2.0 |