Awesome GitHub RepositoriesBinary Protocols

Shadowsocks-android is a secure tunneling application and SOCKS5 proxy client for Android. It routes device network traffic through a Shadowsocks proxy server to encrypt data, mask the user's internet origin, and bypass network restrictions. The client functions as an Android VPN service, creating a virtual network interface to intercept and redirect all outgoing device traffic. It supports the integration of external binary plugins to extend tunnel capabilities with custom transport protocols and traffic obfuscation methods. The project manages network routing through a local SOCKS5 server

NSQ is a distributed, brokerless messaging platform designed for high-throughput, fault-tolerant communication. By utilizing a decentralized topology, it eliminates single points of failure and allows for horizontal scaling across clusters. The system organizes message streams into topics and channels, effectively decoupling producers from consumers to support both streaming and job-oriented workloads. The platform distinguishes itself through a lookup-service-based discovery mechanism that enables clients to dynamically locate producers at runtime without requiring centralized coordination.

Sonic is a high-performance, lightweight search backend designed to provide real-time full-text search and autocomplete capabilities for applications. It functions as a persistent indexing server that maps text terms to object identifiers, allowing developers to integrate rapid search functionality without storing raw document content directly within the search engine. The system distinguishes itself through a specialized graph-based index that enables real-time word prediction and typo correction. Communication is handled via a custom, low-latency binary protocol over raw TCP sockets, which

Goreplay is an HTTP traffic mirroring tool designed to capture live network traffic from production environments and replay it into test systems for validation. It includes a specialized Kubernetes traffic capturer that operates as a daemonset to mirror traffic from specific pods using label selectors and namespace filters, alongside a TCP traffic recorder for intercepting raw network packets. The project features a Kafka traffic pipeline for streaming captured payloads to topics or ingesting messages for playback, and an HTTP request transformer to mask sensitive data or rewrite headers and

GoReplay is a network traffic recording and replay tool used to capture live HTTP and binary protocol requests. It functions as a traffic shadowing proxy that duplicates incoming network requests to test environments and a utility for recording traffic to local or cloud storage for later analysis and playback. The system is capable of processing non-textual data formats, such as Thrift and Protocol Buffers, allowing for the capture and replay of specialized application-to-application communication. The tool supports live traffic capture and asynchronous duplication to validate infrastructure

Qv2ray is a multi-protocol proxy client and a graphical user interface for managing V2Ray network proxy connections. Built as a cross-platform desktop application, it provides a consistent visual experience for configuring traffic routing across Linux, Windows, and macOS. The application utilizes a plugin-based architecture that allows for the integration of third-party extensions to add support for additional network proxy protocols. This modular system enables the software to be extended without modifying the core binary. The tool covers multi-protocol proxy routing for tunneling protocols

This project is a comprehensive Python network request framework designed for both synchronous and asynchronous HTTP communication. It provides a high-performance client capable of executing non-blocking requests within event-driven applications, while also supporting standard blocking calls for simpler scripts. The library is built to operate natively across diverse asynchronous runtimes, automatically detecting and utilizing the underlying event loop for concurrency. What distinguishes this library is its modular architecture, which decouples request construction from network execution thro

Sarama is a Go client library for producing and consuming messages from Apache Kafka clusters. It provides dedicated interfaces for a message producer to send typed data packets and a message consumer to read and process continuous data streams from Kafka topics. The library includes a mocking framework and simulation layer that mimics Kafka broker behavior. These tools allow for the testing of client applications and messaging logic without requiring a live cluster. The project handles cluster connectivity and integration through the implementation of the Kafka binary protocol over TCP. It

Sarama is an Apache Kafka Go client library that provides native support for the Kafka protocol. It includes a protocol client for managing offsets and timestamps, a producer implementation for sending messages, and a consumer group coordinator to balance workloads across multiple instances. The library enables high throughput data streaming through concurrent message production and maintains strict partition ordering during network retries. It supports secure communication with Kafka brokers using certificate-based encryption to protect data traffic. The project covers a broad range of dist

Scapy is a network packet manipulation tool and protocol analysis suite designed for crafting, sending, sniffing, and dissecting network traffic. It functions as a framework for building custom network tools that interact directly with low-level packet headers and payloads, enabling users to perform security research and network diagnostics. The system distinguishes itself through a layer-based construction model that allows users to define protocols as stacked objects, which automatically handle checksums and field offsets. It utilizes dynamic field reflection to map packet structures to bin

Wireshark is a network protocol analyzer and traffic inspector used for capturing and inspecting network traffic. It functions as a packet capture tool that intercepts live data from network interfaces and a TCP/IP dissector that decodes network protocol layers to translate raw binary packets into human-readable fields. The system provides capabilities for protocol stream reconstruction, grouping related packets into cohesive conversations between endpoints. It also operates as a packet file converter, allowing for the reading, modification, and conversion of network capture files across vari

uWebSockets.js is a high-performance tool for building WebSocket and HTTP servers within Node.js. It focuses on high-throughput web servers and real-time data streaming, enabling the creation of network applications that handle a large number of concurrent connections with low memory and CPU overhead. The project distinguishes itself through a native C++ implementation that integrates directly with the Node.js event loop. It utilizes native-layer route matching and a shared memory architecture to minimize allocation overhead and avoid data duplication during message transmission. The impleme

Edgetunnel is a serverless network proxy and VLESS proxy implementation designed to run on Cloudflare Workers. It functions as a VPN proxy that routes network traffic through edge computing platforms to provide an anonymized gateway for outbound internet requests. The project focuses on internet censorship circumvention and the bypass of network restrictions. It utilizes serverless proxy routing to mask original traffic sources and navigate regional filters or firewalls. The system manages traffic through serverless-based proxy tunneling, using WebSocket-based stream forwarding and protocol-

Pixie is an open-source observability platform for Kubernetes that uses eBPF to automatically capture telemetry data from clusters without requiring any manual instrumentation or code changes. It functions as an eBPF telemetry collector, a continuous application profiler, a network traffic analyzer, and a scriptable telemetry query engine, all within a single Kubernetes-native tool. The platform distinguishes itself through several integrated capabilities. It continuously samples stack traces from compiled-language code to identify CPU performance bottlenecks, visualizing the results as inter

websocket-sharp ist eine C#-Bibliotheksimplementierung des WebSocket-Protokolls, die für den Aufbau bidirektionaler Client- und Serveranwendungen verwendet wird. Sie ermöglicht den Echtzeit-Datenaustausch zwischen Endpunkten über persistente Verbindungen. Die Bibliothek bietet spezialisierte Netzwerkfunktionen, einschließlich SSL-verschlüsselter Netzwerkkommunikation für sicheren Transport und Zertifikatsvalidierung. Sie bietet zudem HTTP-Proxy-Tunneling, um Datenverkehr über Zwischenserver unter Verwendung von Basic- oder Digest-Authentifizierung zu leiten. Das Projekt deckt ein breites Spektrum an Funktionen ab, einschließlich der Implementierung von WebSocket-Clients und -Servern, pfadbasiertem Service-Routing und der Möglichkeit, Nachrichten an mehrere Clients zu senden. Es umfasst Unterstützung für die Verwaltung von Handshake-Metadaten und Payload-Kompression, um die Datentransfergröße zu reduzieren.

Handy ist ein C++11-Netzwerkserver-Framework und eine eventgesteuerte Networking-Engine, die für den Aufbau hochperformanter, nebenläufiger TCP- und UDP-Server entwickelt wurde. Es fungiert als asynchrone I/O-Bibliothek und HTTP-Server-Implementierung, die asynchrones Netzwerk-I/O von synchroner Geschäftslogik trennt, um die Serverentwicklung zu vereinfachen. Das Framework zeichnet sich durch die Nutzung plattformspezifischer Event-Benachrichtigungen zur Verwaltung von Millionen gleichzeitiger Netzwerkverbindungen und die Bereitstellung eines SSL/TLS-Netzwerk-Wrappers für verschlüsselte asynchrone Datenübertragung aus. Es implementiert ein Half-Sync/Half-Async-Verarbeitungsmodell und einen Event-Loop-basierten Reactor, um hohe Nebenläufigkeit aufrechtzuerhalten. Das Projekt deckt ein breites Spektrum an Networking-Funktionen ab, darunter pfadbasiertes HTTP-Routing, benutzerdefiniertes Binärprotokoll-Design mittels Codec-basierter Message-Framing und thread-sicheres I/O-Task-Dispatching. Es enthält zudem Dienstprogramme für das Connection-Lifecycle-Management, Timer-Wheel-Task-Scheduling für zeitgesteuerte Ausführung und Koordination für ein Graceful-Shutdown.

Iggy is a distributed message streaming platform and multi-protocol message broker that functions as a persistent distributed log store. It provides infrastructure for publishing and consuming binary messages using an append-only log, ensuring high availability and data consistency across nodes through Viewstamped Replication. The platform is distinguished by its specialized LLM streaming infrastructure, which uses a server protocol to connect large language models to streaming data and system controls. This includes standardized protocols for context management and data bridging via HTTP or

amqp.node is a Node.js client and asynchronous messaging middleware designed for communicating with message brokers using the AMQP 0-9-1 protocol. It enables the creation of decoupled, event-driven architectures where independent components exchange data via queues and exchanges. The library features a multiplexed channel manager that operates multiple logical communication streams over a single persistent connection. It includes stateful connection recovery tools that automatically restore broken network links and re-establish message consumers after service interruptions. The implementatio

PCredz is a network credential extraction tool and traffic analyzer designed to intercept passwords, hashes, and tokens from IPv4 and IPv6 traffic. It functions as both a real-time monitor for live network interfaces and a parser for saved packet capture files. The tool identifies sensitive information, including credit card numbers and authentication tokens, using protocol-aware parsing. It further acts as a password hash recovery utility by normalizing captured authentication hashes into specific syntaxes compatible with external recovery software. Capabilities include real-time traffic in

Android SMS Gateway ist eine selbstgehostete Messaging-Infrastruktur, die Android-Geräte in programmierbare Gateways für das Senden und Empfangen von SMS- und MMS-Nachrichten verwandelt. Durch die Bereitstellung einer lokalen RESTful-API und einer SMPP-Brücke ermöglicht das Projekt Entwicklern, zellulare Messaging-Funktionen direkt in ihre eigenen Anwendungen zu integrieren, ohne auf Cloud-Anbieter von Drittanbietern angewiesen zu sein. Die Plattform zeichnet sich durch fortgeschrittene Traffic-Management- und Orchestrierungsfunktionen aus, die für Messaging mit hohem Volumen konzipiert sind. Sie enthält eine Multi-SIM-Routing-Engine, die ausgehenden Traffic auf mehrere verbundene Geräte verteilt, um den Durchsatz zu optimieren, Kosten zu verwalten und von Netzbetreibern auferlegte Limits zu umgehen. Um eine zuverlässige Zustellung zu gewährleisten und Spam-Filter zu vermeiden, integriert das Gateway automatisiertes Traffic-Throttling, SIM-Rotation und Exponential-Backoff-Retry-Strategien. Das System bietet eine umfassende Suite an Tools für sichere Automatisierung und administrative Kontrolle. Es unterstützt Ende-zu-Ende-Nachrichtenverschlüsselung, kryptografische Payload-Signierung für Webhooks und API-Authentifizierung zum Schutz sensibler Daten. Zudem bietet das Gateway tiefe Einblicke in den Hardwarestatus, einschließlich SIM-Details und System-Telemetrie, während es gleichzeitig eine flexible Konfiguration der Netzwerk-Exposition und Nachrichtenplanung ermöglicht. Das Projekt ist für die lokale Bereitstellung konzipiert und enthält Unterstützung für sicheres Tunneling und Zertifikatsmanagement, um Entwicklung und Tests zu erleichtern.