obsidiandynamics/kafdrop
Kafdrop
Kafdrop is a web-based interface for monitoring and managing Apache Kafka clusters, topics, brokers, and consumer groups. It functions as a cluster monitor and topic manager that provides a visual representation of broker health, partition assignments, and consumer group lag.
The system includes a message browser capable of reading, decoding, and publishing messages to Kafka topics using schema registries or descriptor files. It also provides a metadata API that exposes cluster information through JSON endpoints for integration with external monitoring tools.
The platform covers administrative areas such as topic lifecycle management, security auditing of access control lists, and the establishment of encrypted broker connections using TLS certificates and SASL credentials. Observability capabilities include tracking per-partition offsets and calculating consumer group lag.
Features
- Kafka Management Interfaces - Provides a web-based graphical user interface for monitoring and administering Apache Kafka clusters, topics, and brokers.
- Consumer Lag Monitoring - Tracks consumer group offsets and calculates partition lag to ensure data processing keeps pace.
- Kafka Message Browsers - Provides a visual interface to read and decode messages within Kafka topics using schemas or descriptor files.
- Kafka Resource Controllers - Provides a centralized dashboard to control topic lifecycles, partition assignments, and configuration policies.
- Kafka Cluster Health Monitors - Visualizes broker health, partition assignments, and consumer group lag for real-time Kafka cluster monitoring.
- Topic Configuration - Enables the creation, deletion, and configuration of Kafka topics, including partition counts and replication status.
- Telemetry Visualizations - Transforms raw Kafka cluster metadata and partition offsets into structured views for health and lag monitoring.
- Kafka Protocol Bridges - Translates HTTP requests into Kafka protocol commands to allow topic and consumer group management via a web browser.
- Message Decoders - Uses local configuration files to decode raw binary Kafka messages into structured data for browsing.
- Schema Registry Clients - Integrates with external schema registries to decode binary Kafka messages into readable formats.
- Metadata Export APIs - Provides JSON endpoints to export cluster metadata and topic lists for integration with external monitoring tools.
- Authenticated Connections - Establishes encrypted and authenticated links to Kafka brokers using TLS certificates and SASL credentials.
- Manual Message Publishing - Allows users to publish new messages directly to a specified Kafka topic through the user interface.
- Access Control Lists - Provides a visual interface to audit and review configured access control lists for Kafka resources.
- TLS-SASL Transport Security - Establishes secure connections to brokers using encrypted certificates and SASL credentials.
- Kafka Permissions Management - Provides a view of current access control lists to audit security permissions and manage encrypted broker connections.
- Metadata Export Integrations - Exports cluster information and topic lists as JSON to integrate Kafka data with external monitoring tools.
- Metadata Retrieval APIs - Provides a set of JSON endpoints that expose Kafka cluster information for integration with external monitoring tools.
- View-Mirroring APIs - Serves JSON endpoints that mirror web views to grant programmatic access to internal cluster information.
- JSON APIs - Exposes cluster data through public JSON endpoints for programmatic consumption by external tools.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
