3 repository-uri
Manually commit message offsets after processing to control exactly when progress is recorded in stream consumption.
Distinguishing note: No candidate covers manual offset committing in stream processing; closest candidates relate to VCS commit messages.
Explore 3 awesome GitHub repositories matching data & databases · Offset Commit Managers. Refine with filters or upvote what's useful.
Kafka library in Go
Provides explicit offset commit control for Kafka consumer progress tracking.
KafkaJS is a pure JavaScript client for Apache Kafka, providing the necessary tools to produce and consume messages from a Kafka cluster without requiring native dependencies or external addons. It functions as a comprehensive integration library for Node.js applications to engage in distributed message processing and real-time event streaming. The project is distinguished by its native implementation of the Kafka wire protocol, avoiding C++ dependencies. It features a security client supporting SSL, TLS, and SASL authentication, alongside transactional capabilities that allow for atomic mess
Records processed message positions based on time intervals, message counts, or manual triggers.
Burrow is a monitoring and alerting service for Kafka clusters. It tracks consumer group lag by evaluating committed offsets and identifying the gap between produced and consumed messages. The system calculates processing delays using a sliding-window offset evaluation and monitors overall cluster health. When consumer group conditions meet predefined thresholds, it triggers notifications to external services via email or webhooks. The service provides HTTP endpoints for querying broker information and consumer group status, allowing external tools to poll for system health and performance m
Calculates consumer lag by tracking committed offsets over a specific time interval to detect processing delays.