Awesome GitHub RepositoriesParallel Query Execution

Druid is a distributed columnar store and online analytical processing database designed for real-time analytics. It functions as a SQL analytics platform and a streaming data ingestion engine, allowing for the analysis of large datasets with low latency to support interactive dashboards and high-concurrency operational workloads. The system integrates a streaming data ingestion engine that loads information via batch or streaming processes to enable immediate analysis of arriving data. It provides high-performance analytical processing to execute slice-and-dice queries on massive data volume

Apache Druid is a real-time OLAP database and distributed analytics engine. It functions as a columnar time-series database designed for high-performance analytical queries and the real-time ingestion of streaming and batch datasets. The system provides a framework for high-concurrency analytics, allowing multiple simultaneous users to execute SQL and native queries across large-scale data. It supports mixed data ingestion, combining real-time streaming and batch loading into a single system for unified analysis. The platform includes capabilities for distributed cluster management, enabling

Citus is a PostgreSQL extension that transforms a standard database into a distributed system. It functions as a sharding framework and distributed SQL engine, enabling horizontal scaling by partitioning tables across a cluster of nodes. By utilizing a coordinator-worker topology, the system manages metadata and routes queries to the appropriate nodes, allowing for parallel execution of complex operations across distributed data shards. The platform distinguishes itself through its specialized support for multi-tenant architectures and real-time analytical processing. It enables tenant-based

RisingWave is a cloud-native streaming database and real-time analytics engine that uses standard SQL to process continuous data streams. It functions as a streaming data lakehouse, combining the capabilities of a streaming SQL database with a platform that integrates streaming ingestion with open table formats. The system is distinguished by its use of the PostgreSQL wire protocol, allowing it to integrate with existing SQL tools and drivers. It employs a decoupled compute and storage architecture, persisting streaming state and materialized views in cloud object storage to enable independen

GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without

Cortex is an open-source, horizontally scalable metrics platform that ingests, stores, and queries Prometheus-compatible time-series data with multi-tenant isolation. It accepts metrics via Prometheus remote write and OpenTelemetry, executes PromQL queries against both recent and historical data, and provides a Prometheus-compatible alerting and recording rule engine with an integrated Alertmanager. The system is built as a set of independently scalable microservices that use hash-ring-based sharding, gossip-based cluster membership, and tenant-aware object storage to distribute workloads acro

Titan एक वितरित ग्राफ़ डेटाबेस और कंप्यूटिंग इंजन है जिसे मल्टी-मशीन क्लस्टर में परस्पर जुड़े नोड्स और किनारों के विशाल डेटासेट को संग्रहीत और क्वेरी करने के लिए डिज़ाइन किया गया है। यह एक स्केलेबल ग्राफ़ स्टोरेज लेयर और ट्रांजेक्शनल स्टोर के रूप में कार्य करता है, जो बड़े पैमाने पर ग्राफ़ प्रोसेसिंग जॉब्स और डीप ट्रैवर्सल को निष्पादित करने के लिए एक फ्रेमवर्क प्रदान करता है। सिस्टम अपने प्लगेबल स्टोरेज बैकएंड द्वारा प्रतिष्ठित है, जो ग्राफ़ इंजन को भौतिक दृढ़ता परत से अलग करता है। यह प्रसंस्करण भार को संतुलित करने के लिए वर्टेक्स-कट डेटा विभाजन और एक सेट-कार्डिनैलिटी प्रॉपर्टी मॉडल का उपयोग करता है जो एकल गुणों को कई मान संग्रहीत करने की अनुमति देता है। प्लेटफ़ॉर्म भौगोलिक और पूर्ण-टेक्स्ट खोजों के लिए मल्टी-मॉडल ग्राफ़ इंडेक्सिंग, डेटासेट को फिर से इंडेक्स करने के लिए वैश्विक स्कीमा प्रबंधन और राइट-अहेड लॉगिंग द्वारा सुनिश्चित ट्रांजेक्शनल ऑपरेशंस सहित क्षमताओं की एक विस्तृत श्रृंखला को कवर करता है। यह टाइम-टू-लाइव सेटिंग्स के माध्यम से एलिमेंट समाप्ति और क्वेरी गतिविधि और ट्रांजेक्शन विलंबता को ट्रैक करने के लिए सिस्टम प्रदर्शन निगरानी को भी शामिल करता है।

Memgraph is an in-memory, distributed graph database designed for high-performance labeled property graph management. It utilizes a Cypher query engine for declarative data retrieval and manipulation, providing a scalable knowledge graph backend that integrates vector search and graph traversals. The system distinguishes itself as a real-time graph analytics platform, employing native C++ and CUDA implementations to execute complex network analysis and dynamic community detection on streaming data. It provides specialized support for AI integration, including GraphRAG capabilities, the constr

pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency