awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
segmentio avatar

segmentio/kafka-go

0
View on GitHub↗
8,581 stars·850 forks·Go·MIT·18 views

Kafka Go

Kafka library in Go

Features

  • Kafka Client Libraries - Provides a native, idiomatic Go client library for producing and consuming messages from Apache Kafka.
  • Go Client Libraries - Serves as a Go library for producing and consuming messages from Apache Kafka clusters.
  • Consumer Group Clients - Implements the Kafka consumer group protocol for coordinated message consumption and offset commits.
  • Go Consumer Libraries - Provides a Go library for consuming Kafka messages with automatic offset management.
  • Go Producer Libraries - Provides a Go library for producing Kafka messages with batching and compression.
  • Partition Readers - Provides a reader abstraction for consuming messages from a single Kafka partition with automatic offset management.
  • Kafka Broker Connections - Provides low-level connection abstraction for direct Kafka broker protocol interaction.
  • Consumer Group Coordinators - Implements the Kafka consumer group protocol for coordinated message consumption and offset commits.
  • Consumer Group Managers - Joins consumer groups for broker-managed offset commits and automatic rebalancing.
  • Message Broker Producers - Sends messages to topics through a writer that handles retries and partition distribution.
  • Topic Message Listeners - Reads messages from a single topic-partition pair with automatic offset and reconnection management.
  • Topic Producers - Provides a writer abstraction for producing messages to Kafka topics with batching and retry logic.
  • Offset Commit Managers - Provides explicit offset commit control for Kafka consumer progress tracking.
  • Message Compression Codecs - Compresses produced messages with codecs like Snappy to reduce network bandwidth usage.
  • Pluggable Compression Codecs - Provides pluggable compression codec integration for Kafka message production and consumption.
  • SASL Implementations - Supports pluggable SASL authentication mechanisms for secure Kafka broker connections.
  • Kafka - Implements pluggable SASL authentication mechanisms for secure Kafka broker connections.
  • SSL/TLS Connection Security - Secures connections to Kafka clusters by configuring TLS on the dialer.
  • Security Dialers - Allows TLS configuration on the dialer, inherited by all connections, readers, and writers.

Star history

Star history chart for segmentio/kafka-goStar history chart for segmentio/kafka-go

How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Open-source alternatives to Kafka Go

Similar open-source projects, ranked by how many features they share with Kafka Go.
  • dpkp/kafka-pythondpkp avatar

    dpkp/kafka-python

    5,896View on GitHub↗

    kafka-python is a pure-Python client library for Apache Kafka that implements the Kafka wire protocol directly, without any native bindings or JVM dependencies. It provides the core capabilities of a Kafka client: producing messages to topics, consuming records from topics, and administering cluster resources such as topics and partitions, all through a Pythonic API or command-line tools. The library distinguishes itself through its comprehensive support for advanced Kafka features. It includes an asynchronous producer with background batching for throughput, a consumer group rebalance protoc

    Python
    View on GitHub↗5,896
  • tulios/kafkajstulios avatar

    tulios/kafkajs

    3,997View on GitHub↗

    KafkaJS is a pure JavaScript client for Apache Kafka, providing the necessary tools to produce and consume messages from a Kafka cluster without requiring native dependencies or external addons. It functions as a comprehensive integration library for Node.js applications to engage in distributed message processing and real-time event streaming. The project is distinguished by its native implementation of the Kafka wire protocol, avoiding C++ dependencies. It features a security client supporting SSL, TLS, and SASL authentication, alongside transactional capabilities that allow for atomic mess

    JavaScriptkafkakafka-clientnodejs
    View on GitHub↗3,997
  • shopify/saramaShopify avatar

    Shopify/sarama

    12,490View on GitHub↗

    Sarama is a Go client library for producing and consuming messages from Apache Kafka clusters. It provides dedicated interfaces for a message producer to send typed data packets and a message consumer to read and process continuous data streams from Kafka topics. The library includes a mocking framework and simulation layer that mimics Kafka broker behavior. These tools allow for the testing of client applications and messaging logic without requiring a live cluster. The project handles cluster connectivity and integration through the implementation of the Kafka binary protocol over TCP. It

    Go
    View on GitHub↗12,490
  • ibm/saramaIBM avatar

    IBM/sarama

    12,490View on GitHub↗

    Sarama is an Apache Kafka Go client library that provides native support for the Kafka protocol. It includes a protocol client for managing offsets and timestamps, a producer implementation for sending messages, and a consumer group coordinator to balance workloads across multiple instances. The library enables high throughput data streaming through concurrent message production and maintains strict partition ordering during network retries. It supports secure communication with Kafka brokers using certificate-based encryption to protect data traffic. The project covers a broad range of dist

    Gogokafkakafka-client
    View on GitHub↗12,490
See all 30 alternatives to Kafka Go→

Frequently asked questions

What does segmentio/kafka-go do?

Kafka library in Go

What are the main features of segmentio/kafka-go?

The main features of segmentio/kafka-go are: Kafka Client Libraries, Go Client Libraries, Consumer Group Clients, Go Consumer Libraries, Go Producer Libraries, Partition Readers, Kafka Broker Connections, Consumer Group Coordinators.

What are some open-source alternatives to segmentio/kafka-go?

Open-source alternatives to segmentio/kafka-go include: dpkp/kafka-python — kafka-python is a pure-Python client library for Apache Kafka that implements the Kafka wire protocol directly,… tulios/kafkajs — KafkaJS is a pure JavaScript client for Apache Kafka, providing the necessary tools to produce and consume messages… shopify/sarama — Sarama is a Go client library for producing and consuming messages from Apache Kafka clusters. It provides dedicated… ibm/sarama — Sarama is an Apache Kafka Go client library that provides native support for the Kafka protocol. It includes a… airtai/faststream — FastStream is an asynchronous Python framework designed for building event-driven microservices. It provides a unified… confluentinc/confluent-kafka-go — This is a Go language client library for Apache Kafka, providing the tools necessary to produce and consume messages…