provectus/kafka-ui
Kafka Ui
kafka-ui is a web interface and centralized control plane for administering Apache Kafka clusters, topics, and brokers. It functions as a distributed message queue dashboard and orchestrator, allowing for the oversight of multiple distributed Kafka environments from a single management interface.
The project provides dedicated tools for producing and inspecting messages within topics using various serialization and encoding formats. It includes a schema registry client for defining and versioning data schemas and a consumer monitoring dashboard to track offsets and calculate partition lag.
The system covers cluster administration, including the management of brokers and topic configurations. It incorporates security through a role-based access control manager that integrates with identity providers to govern user permissions and mask sensitive data.
Features
- Cluster Management Interfaces - Provides a unified web-based dashboard for managing broker status and partition assignments across multiple Kafka clusters.
- Kafka Cluster Administration - Provides a centralized control plane for managing Kafka brokers, topics, and general cluster infrastructure.
- Consumer Lag Monitoring - Calculates consumer lag by comparing produced and committed offsets for each partition.
- Kafka Message Browsers - Ships a tool for producing and inspecting messages within topics using various serialization formats.
- Message Browsers - Provides an interface to produce data to topics and inspect the resulting messages in various formats.
- Message Queue Dashboards - Functions as a centralized monitoring system for tracking cluster health and consumer lag across environments.
- Kafka Permissions Management - Implements a role-based access control manager to govern user permissions across Kafka resources.
- Identity and Role Management - Manages user identities and assigns administrative or functional roles to control interface access.
- Identity Provider Integrations - Integrates with external identity providers to verify user credentials and manage access to the interface.
- Role-Based Access Control - Implements a security layer that verifies user identity and permissions against defined roles before accessing cluster resources.
- Access Control - Secures the management interface using standardized authentication protocols to enforce user roles.
- Cluster Administration - Provides a centralized dashboard for overseeing the health and administration of multiple distributed Kafka clusters.
- Topic Configuration - Allows users to define and adjust partition counts and replication status for Kafka topics.
- Kafka Management Interfaces - Provides a comprehensive web interface for administering Kafka clusters, topics, and brokers without command line tools.
- Data Serialization - Provides mechanisms to transform raw bytes into readable formats using built-in schema services or plugins.
- Schema Versioning - Includes a schema registry client for defining and versioning data formats to ensure consistent encoding.
- Multi-Cluster Orchestrators - Acts as a centralized control plane for the operational administration of multiple distributed Kafka clusters.
- Multi-Cluster Management Systems - Provides a unified dashboard to oversee the health and configuration of multiple independent Kafka environments.
- Message Broker Producers - Implements a producer interface to send records to specific Kafka topics with delivery verification.
- Pluggable Serialization - Implements a modular system of encoders and decoders to support formats like JSON, Avro, and Protobuf.
- Schema Registries - Integrates with schema registries to fetch versioned schemas and decode binary messages into human-readable formats.
- Schema Registry Management - Provides an interface to create and maintain versioned definitions for data formats via schema registries.
- Cluster Monitoring Systems - Tracks critical performance metrics and cluster health via a lightweight monitoring dashboard.
