Sarama

Sarama is a Go client library for producing and consuming messages from Apache Kafka clusters. It provides dedicated interfaces for a message producer to send typed data packets and a message consumer to read and process continuous data streams from Kafka topics.

The library includes a mocking framework and simulation layer that mimics Kafka broker behavior. These tools allow for the testing of client applications and messaging logic without requiring a live cluster.

The project handles cluster connectivity and integration through the implementation of the Kafka binary protocol over TCP. It covers the management of cluster metadata, partition state, and asynchronous event production.

Features

Kafka Client Libraries - Provides a comprehensive Go library for producing and consuming messages from Apache Kafka clusters.
Distributed Messaging - Provides a typed client for sending data packets to a distributed message cluster for asynchronous communication.
Go Libraries - Implemented as a library for the Go programming language to interact with Kafka clusters.
Partition Offset Management - Tracks offset positions and partition assignments locally to manage data consumption and ensure ordered message processing.
Message Broker Connectivity - Establishes communication between an application and a distributed Kafka cluster to exchange event streams.
Distributed Messaging - Provides capabilities for reading and processing continuous data streams from a distributed Kafka cluster.
Binary Protocols - Implements the Kafka wire protocol by encoding and decoding binary messages over raw TCP sockets.
Message Broker Consumers - Implements a streaming interface for reading and processing continuous data streams from Kafka topics.
Message Broker Producers - Provides a client implementation for sending typed data packets to a distributed Kafka message cluster.
Topic Message Listeners - Provides mechanisms for reading and processing continuous data streams from Kafka topics to trigger application logic.
Asynchronous Message Production - Enables decoupled communication between microservices by sending data packets asynchronously to a Kafka cluster.
Cluster Topology Caching - Maintains a local cache of broker and partition leader maps to route requests efficiently without repeated network lookups.
Message Batching - Implements internal buffering to collect multiple outgoing messages, reducing network overhead and increasing producer throughput.
Asynchronous Producer Pipelines - Utilizes Go channels to asynchronously dispatch messages to different partition leaders across concurrent routines.
Dependency Mocking - Uses Go interfaces to decouple the client logic from the network layer for simulating broker behavior during tests.
Cluster Integration Testing - Simulates cluster behavior with mock components to validate messaging logic without requiring a live broker.
Mocking Frameworks - Provides a set of tools and simulation layers to mimic Kafka broker behavior for testing client applications.
Message Queues - Client library for Apache Kafka.
Messaging and RPC - A client library for Apache Kafka.
Message Queues and Brokers - Library for interacting with Apache Kafka clusters.
Messaging Systems - Library for interacting with Apache Kafka.
Messaging Systems - Apache Kafka client library.

Historial de estrellas

Shopifysarama

Name: shopify/sarama
Author: Shopify

View on GitHub

12,490 estrellas1,843 forksGoMIT12 vistas

Sarama

Features

Kafka Client Libraries - Provides a comprehensive Go library for producing and consuming messages from Apache Kafka clusters.
Distributed Messaging - Provides a typed client for sending data packets to a distributed message cluster for asynchronous communication.
Go Libraries - Implemented as a library for the Go programming language to interact with Kafka clusters.
Partition Offset Management - Tracks offset positions and partition assignments locally to manage data consumption and ensure ordered message processing.
Message Broker Connectivity - Establishes communication between an application and a distributed Kafka cluster to exchange event streams.
Distributed Messaging - Provides capabilities for reading and processing continuous data streams from a distributed Kafka cluster.
Binary Protocols - Implements the Kafka wire protocol by encoding and decoding binary messages over raw TCP sockets.
Message Broker Consumers - Implements a streaming interface for reading and processing continuous data streams from Kafka topics.
Message Broker Producers - Provides a client implementation for sending typed data packets to a distributed Kafka message cluster.
Topic Message Listeners - Provides mechanisms for reading and processing continuous data streams from Kafka topics to trigger application logic.
Asynchronous Message Production - Enables decoupled communication between microservices by sending data packets asynchronously to a Kafka cluster.
Cluster Topology Caching - Maintains a local cache of broker and partition leader maps to route requests efficiently without repeated network lookups.
Message Batching - Implements internal buffering to collect multiple outgoing messages, reducing network overhead and increasing producer throughput.
Asynchronous Producer Pipelines - Utilizes Go channels to asynchronously dispatch messages to different partition leaders across concurrent routines.
Dependency Mocking - Uses Go interfaces to decouple the client logic from the network layer for simulating broker behavior during tests.
Cluster Integration Testing - Simulates cluster behavior with mock components to validate messaging logic without requiring a live broker.
Mocking Frameworks - Provides a set of tools and simulation layers to mimic Kafka broker behavior for testing client applications.
Message Queues - Client library for Apache Kafka.
Messaging and RPC - A client library for Apache Kafka.
Message Queues and Brokers - Library for interacting with Apache Kafka clusters.
Messaging Systems - Library for interacting with Apache Kafka.
Messaging Systems - Apache Kafka client library.

Alternativas open-source a Sarama

Proyectos open-source similares, clasificados según cuántas características comparten con Sarama.

confluentinc/confluent-kafka-go
confluentinc/confluent-kafka-go
5,144Ver en GitHub
This is a Go language client library for Apache Kafka, providing the tools necessary to produce and consume messages from Kafka brokers. It serves as a Kafka client implementation for building applications that integrate with Kafka for real-time data streaming and messaging. The library includes support for validated cryptographic modules to ensure network connections meet federal security and encryption standards for FIPS compliance. The client provides capabilities for asynchronous message production with delivery reports and message consumption using balanced consumer groups and regex sub
HTMLconfluentconsumergolang
Ver en GitHub5,144
nats-io/nats-server
nats-io/nats-server
20,076Ver en GitHub
NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t
Gocloudcloud-computingcloud-native
Ver en GitHub20,076
nsqio/nsq
nsqio/nsq
25,738Ver en GitHub
NSQ is a distributed, brokerless messaging platform designed for high-throughput, fault-tolerant communication. By utilizing a decentralized topology, it eliminates single points of failure and allows for horizontal scaling across clusters. The system organizes message streams into topics and channels, effectively decoupling producers from consumers to support both streaming and job-oriented workloads. The platform distinguishes itself through a lookup-service-based discovery mechanism that enables clients to dynamically locate producers at runtime without requiring centralized coordination.
Godistributed-systemsgomessage-queue
Ver en GitHub25,738
segmentio/kafka-go
segmentio/kafka-go
8,581Ver en GitHub
Kafka library in Go
Goconsumergogolang
Ver en GitHub8,581

Ver las 30 alternativas a Sarama

Preguntas frecuentes

¿Qué hace shopify/sarama?

¿Cuáles son las características principales de shopify/sarama?

Las características principales de shopify/sarama son: Kafka Client Libraries, Distributed Messaging, Go Libraries, Partition Offset Management, Message Broker Connectivity, Binary Protocols, Message Broker Consumers, Message Broker Producers.

¿Qué alternativas de código abierto existen para shopify/sarama?

Las alternativas de código abierto para shopify/sarama incluyen: confluentinc/confluent-kafka-go — This is a Go language client library for Apache Kafka, providing the tools necessary to produce and consume messages… nats-io/nats-server — NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge… nsqio/nsq — NSQ is a distributed, brokerless messaging platform designed for high-throughput, fault-tolerant communication. By… segmentio/kafka-go — Kafka library in Go. dpkp/kafka-python — kafka-python is a pure-Python client library for Apache Kafka that implements the Kafka wire protocol directly,… airtai/faststream — FastStream is an asynchronous Python framework designed for building event-driven microservices. It provides a unified…