yahoo/CMAK
CMAK
CMAK is a Kafka cluster management tool and web interface designed for the administration of brokers, topics, and partitions. It provides a centralized system for Kafka cluster governance, encompassing resource administration, access control, and data distribution optimization.
The project features a management UI that allows for the creation, deletion, and update of topic configurations and partition counts. It includes a partition rebalancer for executing data reassignment and preferred replica elections to balance load across cluster nodes.
The system provides observability through broker performance monitoring via Java Management Extensions and consumer lag tracking. It also integrates with LDAP directory servers to verify user identities and group permissions for administrative access.
Features
- Kafka Cluster Administration - Provides a centralized system for managing Kafka brokers and topic configurations to ensure stable data streaming.
- Kafka Partition Balancers - Executes preferred replica elections and partition reassignments to prevent hotspots across nodes.
- Preferred Replica Elections - Implements preferred replica elections to balance partition leaders across available cluster nodes.
- Topic Configuration - Provides a way to modify Kafka topic configurations, partition counts, and deletion status via administrative requests.
- Kafka Management Interfaces - Provides a web-based graphical user interface for administering Kafka topics, brokers, and partitions.
- Partition Reassignment Tools - Ships a utility to assign partitions to specific brokers and execute data reassignment to balance cluster load.
- Kafka Metadata Management - Governs the lifecycle of Kafka topics, adjusting partition counts and reassigning data for optimization.
- JMX Monitoring - Polls Kafka broker performance data by querying Java Management Extensions interfaces for real-time system state.
- Message Brokers - Polls performance data for Kafka brokers and topics via the Java Management Extensions interface.
- Consumer Lag Monitoring - Calculates consumer delay by comparing current consumer offsets with the latest producer offsets.
- Distributed Leader Election - Triggers the movement of partition leadership across brokers to balance load and ensure high availability.
- Kafka Permissions Management - Integrates LDAP authentication to manage user identities and secure access to Kafka cluster resources.
- LDAP Authentication - Verifies user identities and group memberships by communicating with an external LDAP directory server.
- Kafka Cluster Health Monitors - Collects JMX metrics and tracks consumer lag to monitor the health of Kafka clusters.
- Cluster Metadata Inspections - Inspects cluster metadata to map the distribution of replicas and partitions across all active broker nodes.
- Cluster State Inspections - Provides an observability tool to analyze the distribution of replicas and partitions across brokers and consumers.
- Data Processing and Analytics - Management tool for Apache Kafka clusters.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
