4 dépôts
Grouping multiple messages together for transmission to improve network throughput.
Distinct from Data Buffering: Distinct from general Data Buffering by focusing on batching for transmission efficiency rather than flow control or disk-backed stability.
Explore 4 awesome GitHub repositories matching data & databases · Message Batching. Refine with filters or upvote what's useful.
Sarama is a Go client library for producing and consuming messages from Apache Kafka clusters. It provides dedicated interfaces for a message producer to send typed data packets and a message consumer to read and process continuous data streams from Kafka topics. The library includes a mocking framework and simulation layer that mimics Kafka broker behavior. These tools allow for the testing of client applications and messaging logic without requiring a live cluster. The project handles cluster connectivity and integration through the implementation of the Kafka binary protocol over TCP. It
Implements internal buffering to collect multiple outgoing messages, reducing network overhead and increasing producer throughput.
Hyperf is a high-performance PHP coroutine framework designed for building microservices and middleware. It utilizes non-blocking coroutines to handle high concurrency and low-latency request processing, providing a foundation for scalable distributed systems. The framework is distinguished by an aspect-oriented programming based dependency injector that enables pluggable components and meta-programming. It includes a coroutine-optimized object-relational mapper with integrated model caching and an orchestration toolkit for microservice governance, featuring service discovery, circuit breaker
Implements synchronous and asynchronous message batching for Kafka to optimize network throughput.
BitChat Android is a decentralized peer-to-peer messenger that enables communication over Bluetooth mesh networks without requiring any internet connection or central servers. It functions as a full mesh network chat app and a privacy-focused communication tool, with every message encrypted end-to-end using per-session cryptographic keys that ensure forward secrecy. The app operates without accounts or persistent identifiers, resisting user tracking at the protocol level. To strengthen privacy and efficiency, BitChat injects cover traffic to obscure real communication patterns and includes an
Queues small outgoing messages and transmits them as a single batch to reduce network overhead and energy consumption.
This project is a reference library of architectural blueprints, study materials, and design patterns for building scalable, high-availability distributed systems. It serves as a technical guide for scalability engineering, providing structural solutions for common engineering challenges. The repository focuses on distributed systems design, covering essential patterns for data replication, consensus algorithms, and transaction management. It distinguishes itself by offering detailed blueprints for specialized domains, including real-time data streaming, large-scale data storage, and high-ava
Implements message batching to group multiple transmissions into single requests for higher throughput.