# yahoo/kafka-manager

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/yahoo-kafka-manager).**

11,926 stars · 2,479 forks · Scala · Apache-2.0

## Links

- GitHub: https://github.com/yahoo/kafka-manager
- awesome-repositories: https://awesome-repositories.com/repository/yahoo-kafka-manager.md

## Description

Kafka Manager is a web-based management interface and monitoring tool for Apache Kafka clusters. It serves as a central control plane for topic administration, consumer monitoring, and cluster health inspection.

The project provides specialized utilities for data rebalancing and partition reassignment to distribute workloads across brokers. It also includes tools to optimize partition leadership by electing preferred replicas.

The platform covers a broad range of administrative capabilities, including the creation and configuration of message topics, tracking of consumer offsets, and the collection of broker performance metrics. Access to these operations is managed through identity validation and role-based restrictions via directory servers.

## Tags

### System Administration & Monitoring

- [Kafka Cluster Administration](https://awesome-repositories.com/f/system-administration-monitoring/kafka-cluster-administration.md) — Provides a centralized interface for managing Kafka brokers and topics to maintain cluster health.
- [Cluster Health Monitoring](https://awesome-repositories.com/f/system-administration-monitoring/cluster-health-monitoring.md) — Monitors topics, consumers, offsets, and broker distribution across multiple clusters to ensure stability. ([source](https://github.com/yahoo/kafka-manager#readme))
- [Shard Rebalancing](https://awesome-repositories.com/f/system-administration-monitoring/cluster-management/shard-rebalancing.md) — Moves data partitions between brokers to ensure even workload distribution and optimize performance.
- [Topic Configuration](https://awesome-repositories.com/f/system-administration-monitoring/cluster-management/topic-configuration.md) — Provides tools to create, delete, and update Kafka topic configurations and partition counts. ([source](https://github.com/yahoo/kafka-manager#readme))
- [Kafka Management Interfaces](https://awesome-repositories.com/f/system-administration-monitoring/kafka-management-interfaces.md) — Provides a web interface for monitoring and managing Apache Kafka clusters, including topics and consumers.
- [Partition Reassignment Tools](https://awesome-repositories.com/f/system-administration-monitoring/kafka-management-interfaces/partition-reassignment-tools.md) — Provides a dedicated utility to generate and execute data partition assignments to balance broker workload.
- [Message Brokers](https://awesome-repositories.com/f/system-administration-monitoring/monitoring-and-observability/observability-platforms/metric-performance-monitors/server-metrics/message-brokers.md) — Retrieves and displays broker and topic level performance metrics using management beans. ([source](https://github.com/yahoo/kafka-manager#readme))

### Data & Databases

- [Consumer Lag Monitoring](https://awesome-repositories.com/f/data-databases/consumer-offset-trackers/consumer-lag-monitoring.md) — Tracks consumer offsets and group progress to identify lag and ensure reliable message processing.
- [JMX Metric Collectors](https://awesome-repositories.com/f/data-databases/data-analysis-visualization/telemetry-usage-analytics/metrics-collection/jmx-metric-collectors.md) — Polls Java Management Extensions (JMX) beans to retrieve real-time performance data from remote Kafka brokers.

### DevOps & Infrastructure

- [Cluster Coordination](https://awesome-repositories.com/f/devops-infrastructure/cluster-coordination.md) — Interacts with Zookeeper to manage topic configurations and track broker registration and health across the cluster.
- [Partition Reassignments](https://awesome-repositories.com/f/devops-infrastructure/load-balancing/partitioning-algorithms/partition-reassignments.md) — Generates and executes new partition assignments across brokers to balance workload and optimize performance. ([source](https://github.com/yahoo/kafka-manager#readme))
- [Distributed Leader Election](https://awesome-repositories.com/f/devops-infrastructure/distributed-leader-election.md) — Runs elections to determine which replica should lead a partition to optimize cluster performance. ([source](https://github.com/yahoo/kafka-manager#readme))

### Artificial Intelligence & ML

- [LDAP Authentication](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/agent-orchestration-multi-agent/security-and-auth/authentication-strategies/identity-providers/ldap-authentication.md) — Validates user credentials against directory servers using LDAP for centralized authentication and access restrictions. ([source](https://github.com/yahoo/kafka-manager#readme))

### Security & Cryptography

- [Kafka Permissions Management](https://awesome-repositories.com/f/security-cryptography/granular-access-controls/kafka-permissions-management.md) — Manages user identities and restricts access to Kafka clusters based on directory server groups.
- [Role-Based Access Control](https://awesome-repositories.com/f/security-cryptography/role-based-access-control.md) — Restricts management operations by validating user group memberships against an external directory server via role-based access control.

### Part of an Awesome List

- [Data Ingestion Pipelines](https://awesome-repositories.com/f/awesome-lists/data/data-ingestion-pipelines.md) — Management interface for Apache Kafka clusters.