Awesome GitHub RepositoriesStreaming SQL

Apache Flink is a distributed processing engine designed for both high-throughput, low-latency data streams and finite batch workloads. It functions as a stateful stream processor and a SQL stream processing engine, providing a unified runtime to execute relational queries and event-based transformations. The system is distinguished by its ability to manage persistent operator state to ensure exactly-once processing guarantees and consistency during failures. It features specialized capabilities for complex event processing to detect temporal patterns and handles out-of-order events using eve

Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postg

High-performance time-series aggregation for PostgreSQL

⚡ Fastest SQL ETL pipeline in a single C++ binary, built for stream processing, observability, analytics and AI/ML

Flink streaming platform web is an administrative management platform and web console designed to build, configure, deploy, and monitor real-time data streaming pipelines and SQL queries. It operates as a centralized web interface for managing stream processing tasks, state recovery, and cluster deployments without requiring raw code writing. The platform provides comprehensive stream processing capabilities including change data capture ingestion, stream-table joins, tumbling and sliding window aggregations, and message queue ingestion. It supports cluster-agnostic job submission, dynamic cl

Stream Processing and Complex Event Processing Engine

The database purpose-built for stream processing applications.

A streaming / online query processing / analytics engine based on Apache Storm

Open-source streaming SQL engine written in Rust using Apache Arrow and DataFusion. Supports continuous queries, temporal stream joins, tumbling/session windows, and CDC/Kafka connectors. Lightweight, embeddable, and sub-microsecond latency

Continuous Query Language (CQL) is a query language used for data streams. Compared with traditional SQL, CQL introduces the concept of window. Data is stored in memory so that in-memory computing can be quickly implemented. CQL query results are computing results at a specific moment of data…