segmentio/kafka-go
Kafka Go
Kafka library in Go
Features
- Kafka Client Libraries - Provides a native, idiomatic Go client library for producing and consuming messages from Apache Kafka.
- Go Client Libraries - Serves as a Go library for producing and consuming messages from Apache Kafka clusters.
- Consumer Group Clients - Implements the Kafka consumer group protocol for coordinated message consumption and offset commits.
- Go Consumer Libraries - Provides a Go library for consuming Kafka messages with automatic offset management.
- Go Producer Libraries - Provides a Go library for producing Kafka messages with batching and compression.
- Partition Readers - Provides a reader abstraction for consuming messages from a single Kafka partition with automatic offset management.
- Kafka Broker Connections - Provides low-level connection abstraction for direct Kafka broker protocol interaction.
- Consumer Group Coordinators - Implements the Kafka consumer group protocol for coordinated message consumption and offset commits.
- Consumer Group Managers - Joins consumer groups for broker-managed offset commits and automatic rebalancing.
- Message Broker Producers - Sends messages to topics through a writer that handles retries and partition distribution.
- Topic Message Listeners - Reads messages from a single topic-partition pair with automatic offset and reconnection management.
- Topic Producers - Provides a writer abstraction for producing messages to Kafka topics with batching and retry logic.
- Offset Commit Managers - Provides explicit offset commit control for Kafka consumer progress tracking.
- Message Compression Codecs - Compresses produced messages with codecs like Snappy to reduce network bandwidth usage.
- Pluggable Compression Codecs - Provides pluggable compression codec integration for Kafka message production and consumption.
- SASL Implementations - Supports pluggable SASL authentication mechanisms for secure Kafka broker connections.
- Kafka - Implements pluggable SASL authentication mechanisms for secure Kafka broker connections.
- SSL/TLS Connection Security - Secures connections to Kafka clusters by configuring TLS on the dialer.
- Security Dialers - Allows TLS configuration on the dialer, inherited by all connections, readers, and writers.
