Awesome GitHub RepositoriesDistributed Query Stream Processors

Presto is a distributed SQL query engine designed for high-performance analytical processing across heterogeneous data sources. It functions as a data federation platform and massively parallel processing engine, allowing users to execute interactive queries against diverse storage systems without requiring data migration. By mapping remote metadata and structures to a unified relational namespace, it enables seamless cross-platform analysis through a standard SQL interface. The engine distinguishes itself through a pluggable connector architecture and a shared-nothing distributed processing

Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer

YDB 是一个分布式 SQL 数据库和分析引擎，专为水平扩展和强一致性而设计。它作为一个多模型系统，通过提供可序列化 ACID 事务的分布式架构支持事务和分析工作负载。 该系统以其广泛的协议兼容性而著称，实现了用于标准 SQL 驱动程序的 PostgreSQL 有线协议和用于消息传递与流处理的 Kafka 协议。它进一步作为向量数据库，支持用于语义搜索和嵌入的向量索引以及近似最近邻搜索。 该平台使用具有行式和列式格式的混合存储模型管理数据，利用向量化查询执行进行 PB 级分析。其操作范围包括变更数据捕获流、精确一次（exactly-once）持久队列和多区域高可用性。 部署和生命周期管理通过 Kubernetes Operator 和基础设施即代码（IaC）配置提供支持。