# segmentio/kafka-go

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/segmentio-kafka-go).**

8,581 stars · 850 forks · Go · MIT

## Links

- GitHub: https://github.com/segmentio/kafka-go
- awesome-repositories: https://awesome-repositories.com/repository/segmentio-kafka-go.md

## Topics

`consumer` `go` `golang` `golang-library` `golang-native` `kafka` `kafka-client` `producer` `segment`

## Description

Kafka library in Go

## Tags

### Data & Databases

- [Kafka Client Libraries](https://awesome-repositories.com/f/data-databases/kafka-client-libraries.md) — Provides a native, idiomatic Go client library for producing and consuming messages from Apache Kafka.
- [Go Client Libraries](https://awesome-repositories.com/f/data-databases/kafka-client-libraries/go-client-libraries.md) — Serves as a Go library for producing and consuming messages from Apache Kafka clusters.
- [Consumer Group Clients](https://awesome-repositories.com/f/data-databases/kafka-client-libraries/consumer-group-clients.md) — Implements the Kafka consumer group protocol for coordinated message consumption and offset commits.
- [Go Consumer Libraries](https://awesome-repositories.com/f/data-databases/kafka-client-libraries/go-consumer-libraries.md) — Provides a Go library for consuming Kafka messages with automatic offset management.
- [Go Producer Libraries](https://awesome-repositories.com/f/data-databases/kafka-client-libraries/go-producer-libraries.md) — Provides a Go library for producing Kafka messages with batching and compression.
- [Partition Readers](https://awesome-repositories.com/f/data-databases/partition-offset-management/partition-readers.md) — Provides a reader abstraction for consuming messages from a single Kafka partition with automatic offset management.
- [Offset Commit Managers](https://awesome-repositories.com/f/data-databases/offset-commit-managers.md) — Provides explicit offset commit control for Kafka consumer progress tracking. ([source](https://cdn.jsdelivr.net/gh/segmentio/kafka-go@main/README.md))

### Networking & Communication

- [Kafka Broker Connections](https://awesome-repositories.com/f/networking-communication/communication-protocols-architectures/communication-protocols-standards/network-protocols/connection-establishment-protocols/tcp-socket-clients/tcp-transmitters/connection-abstractions/kafka-broker-connections.md) — Provides low-level connection abstraction for direct Kafka broker protocol interaction.
- [Consumer Group Coordinators](https://awesome-repositories.com/f/networking-communication/message-broker-consumers/consumer-group-coordinators.md) — Implements the Kafka consumer group protocol for coordinated message consumption and offset commits.
- [Consumer Group Managers](https://awesome-repositories.com/f/networking-communication/message-broker-consumers/consumer-group-managers.md) — Joins consumer groups for broker-managed offset commits and automatic rebalancing. ([source](https://cdn.jsdelivr.net/gh/segmentio/kafka-go@main/README.md))
- [Message Broker Producers](https://awesome-repositories.com/f/networking-communication/message-broker-producers.md) — Sends messages to topics through a writer that handles retries and partition distribution. ([source](https://cdn.jsdelivr.net/gh/segmentio/kafka-go@main/README.md))
- [Topic Message Listeners](https://awesome-repositories.com/f/networking-communication/messaging-api-integrations/topic-message-listeners.md) — Reads messages from a single topic-partition pair with automatic offset and reconnection management. ([source](https://cdn.jsdelivr.net/gh/segmentio/kafka-go@main/README.md))
- [Topic Producers](https://awesome-repositories.com/f/networking-communication/messaging-api-integrations/topic-message-listeners/messaging-topic-governance/topic-producers.md) — Provides a writer abstraction for producing messages to Kafka topics with batching and retry logic.

### Programming Languages & Runtimes

- [Message Compression Codecs](https://awesome-repositories.com/f/programming-languages-runtimes/data-compression-and-decompression/snappy-compression/message-compression-codecs.md) — Compresses produced messages with codecs like Snappy to reduce network bandwidth usage. ([source](https://cdn.jsdelivr.net/gh/segmentio/kafka-go@main/README.md))
- [Pluggable Compression Codecs](https://awesome-repositories.com/f/programming-languages-runtimes/data-compression-and-decompression/snappy-compression/pluggable-compression-codecs.md) — Provides pluggable compression codec integration for Kafka message production and consumption.

### Security & Cryptography

- [SASL Implementations](https://awesome-repositories.com/f/security-cryptography/authentication-clients/credential-authentication/sasl-implementations.md) — Supports pluggable SASL authentication mechanisms for secure Kafka broker connections.
- [Kafka](https://awesome-repositories.com/f/security-cryptography/authentication-clients/credential-authentication/sasl-implementations/kafka.md) — Implements pluggable SASL authentication mechanisms for secure Kafka broker connections.
- [SSL/TLS Connection Security](https://awesome-repositories.com/f/security-cryptography/ssl-tls-connection-security.md) — Secures connections to Kafka clusters by configuring TLS on the dialer. ([source](https://cdn.jsdelivr.net/gh/segmentio/kafka-go@main/README.md))
- [Security Dialers](https://awesome-repositories.com/f/security-cryptography/ssl-tls-connection-security/security-dialers.md) — Allows TLS configuration on the dialer, inherited by all connections, readers, and writers.