1 repo
Systems for tracking the read progress of individual consumers within a data stream.
Distinguishing note: Specific to stream processing state management rather than general database indexing.
Explore 1 awesome GitHub repository matching data & databases · Consumer Offset Trackers. Refine with filters or upvote what's useful.
Kafka is a distributed event streaming platform designed for capturing, storing, and processing real-time data streams across interconnected nodes. It functions as a distributed commit log, providing a fault-tolerant storage mechanism that records state changes sequentially to ensure data consistency and durability across distributed environments. The platform distinguishes itself through a partitioned commit log architecture that enables horizontal scaling and parallel processing of data streams. It integrates a stream processing engine for continuous transformations and aggregations, while
Enables multiple independent consumers to process the same data stream at their own pace via stateful tracking.