Awesome GitHub RepositoriesData Framing

Zstandard is a lossless data compression library and archive format designed for high compression ratios and fast real-time processing. It functions as a real-time data compressor and multi-threaded compression engine capable of distributing workloads across multiple CPU cores to increase throughput. The system features a dictionary-based compressor that trains on sample data to improve the compression ratio and speed of small files. It also provides long distance pattern matching to identify repeated sequences across large files. The library covers a broad range of capabilities including st

This project provides a comprehensive implementation of the WebSocket protocol, enabling persistent, bidirectional communication between clients and servers. It handles the low-level complexities of the protocol, including the initial HTTP upgrade handshake and the encapsulation of data into discrete binary frames. By managing these connections, it allows applications to exchange data instantly without the overhead associated with repeated standard request cycles. The library distinguishes itself through its focus on high-frequency message exchange and concurrent connection management. It uti

This project is a Node.js WebSocket library that provides a high-performance client and server implementation for the WebSocket protocol. It functions as a transport layer for real-time bidirectional communication, supporting both UTF-8 strings and binary data transport through the use of TCP socket wrappers. The library enables the creation of WebSocket servers that manage full-duplex connections and broadcast messages to multiple clients, as well as WebSocket clients that establish persistent links to remote servers. It handles the protocol upgrade process via TCP-based handshake negotiatio

Magic Wormhole is a command-line utility designed for the secure transfer of files and text between two computers. It establishes encrypted, peer-to-peer connections that allow users to move information directly without relying on permanent cloud storage or third-party hosting. The system utilizes a password-authenticated key exchange to verify the identity of both endpoints, requiring only a short, human-readable code to initiate a session. By employing ephemeral key derivation and a relay server that cannot decrypt the transmitted content, the protocol ensures that data remains private and

This project is a cross-platform implementation of the WebRTC standard, providing a comprehensive library for building real-time audio, video, and data communication applications. It functions as a peer-to-peer networking framework and media processing engine, enabling direct, low-latency connections between devices without relying on central servers. By strictly adhering to official protocol specifications, the library ensures interoperability with browsers and other native communication software across mobile, desktop, and server environments. The engine distinguishes itself through a modul

Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech systems. It utilizes a frame-based data pipeline to route audio, video, and text through a modular sequence of processors, enabling the orchestration of low-latency conversational AI. The project is distinguished by its ability to coordinate complex multimodal services, including speech-to-text, language models, and text-to-speech, within a single pipeline. It features semantic voice activity detection for natural turn-taking, state-machine conversation flows for dialogue manag

This project provides a lossless compression algorithm and a byte-oriented compression library designed for high-speed data reduction and maximum decompression speed. It functions as a stream-oriented compression engine, a software library for encoding and decoding data blocks, and a command-line tool for managing interoperable compressed frames. The system distinguishes itself through the use of predefined pattern dictionaries to improve compression ratios for small data sets and small packets. It supports multiple processing modes, including high-speed block compression for minimal latency

F Prime 是一个基于组件的框架，专为嵌入式和航天软件的开发与部署而设计。它提供了一种模块化架构，将软件逻辑与通信接口解耦，允许开发者通过领域特定建模语言定义系统结构。这种基于模型的方法支持自动化代码生成，在确保复杂系统拓扑一致性的同时，维护了软件模块之间严格的接口契约。 该框架的特色在于其集成的构建系统和地面数据操作套件。它实现了嵌入式软件全生命周期的自动化，从交叉编译和依赖管理到遥测与命令接口的生成。通过为机载飞行软件和地面监控提供统一的环境，它促进了跨不同硬件平台的分布式嵌入式系统的无缝集成、测试及指挥控制。 除了核心架构外，该项目还包含用于系统可观测性的综合工具，包括实时遥测可视化、事件日志记录和诊断追踪。它支持从裸机环境到实时操作系统的多种部署场景，并提供了内存管理、状态驱动行为建模和异步任务执行机制。 该项目以 C++ 仓库形式维护，并提供详尽的文档和支持跨平台开发的构建系统。

SignalR is a .NET real-time web framework designed to push content from a server to connected browser and non-browser clients. It provides a server-to-client push framework and a remote procedure call system that enables bidirectional communication over persistent connections. The library utilizes WebSockets to establish full-duplex connections and includes a transport-layer abstraction to manage different network protocols. It employs client-side connection negotiation to determine the best available communication protocol during the initial handshake. The system manages persistent connecti

Starscream is a Swift WebSocket client library that provides a concrete implementation of the WebSocket protocol for iOS and macOS applications. It functions as an event-driven wrapper for establishing and managing bidirectional connections to send and receive text and binary frames over TCP. The library includes a secure WebSocket client capable of encrypting traffic and validating server identities. It manages the full connection lifecycle, from the initial handshake and header exchange to session termination with custom close codes. The project covers a broad range of networking capabilit

This project is an open-source software development kit and framework for implementing the Matter smart home standard. It provides a universal IPv6-based application layer and a cluster-based data model to ensure interoperability between diverse smart home devices and controllers. The system is distinguished by its multi-transport network abstraction, which maps Bluetooth LE, Thread, and Wi-Fi implementations to a common layer. It includes specialized tooling for secure device commissioning via QR codes and NFC, as well as a comprehensive over-the-air firmware update system for distributing s

Hotwire Turbo is a server-driven navigation and HTML streaming framework that intercepts link clicks and form submissions to fetch pages in the background and replace content without full browser reloads. It provides a Turbo Frame component that scopes page regions into independent contexts, enabling partial page updates where only a specific area of the page navigates or loads content. The framework includes a page cache and morph system that stores recently visited pages for instant restoration and applies minimal DOM changes on refresh, preserving scroll position and element state. The fra

Microsandbox is a runtime for creating and managing lightweight, hardware-isolated virtual machines — called sandboxes — that boot directly from standard OCI container images. Each sandbox runs as its own host process with a separate kernel, filesystem, and network stack, providing process-per-sandbox isolation. The project includes a command-line tool and multi-language SDKs (Rust, TypeScript, Python, Go) for programmatic lifecycle control, and it communicates with sandbox agents over Unix sockets using a CBOR-encoded protocol. What distinguishes Microsandbox is its combination of host-manag

Serial Studio is a desktop application for connecting to, decoding, visualizing, and recording data from hardware devices over multiple communication protocols. It functions as an embedded device debugging toolkit that ingests live data from Serial, Bluetooth, CAN, Modbus, MQTT, and network sockets into a unified dashboard, while also serving as a programmatic automation platform with over 320 commands exposed over TCP, gRPC, and MCP for external control. The application distinguishes itself through a scriptable frame pipeline that routes incoming bytes through configurable detection, decodin

This is a high-performance Go compression library providing implementations of Zstandard, Snappy, and Huffman coding. It includes a parallel compression framework for distributing gzip and stream workloads across multiple CPU cores and a specialized Huffman codec optimized for modern CPU architectures. The library features a Zstandard implementation that supports custom dictionaries and allocation-free decoding, alongside a Snappy compatible encoder for high-throughput data processing. It provides specific tools for dictionary generation and optimization to improve compression ratios for smal

This is a minimal WebSocket library for Go designed for bidirectional real-time communication. It serves as a network protocol implementation for managing handshakes, frame masking, and control signals to enable the exchange of text and binary messages over persistent connections. The library distinguishes itself by providing a connectivity layer that wraps browser WebSocket APIs for applications compiled to WebAssembly. It also functions as data compression middleware, utilizing deflate compression to reduce bandwidth usage for transmitted messages. The project covers a broad range of netwo

nghttp2 是一套低级 C 语言库和工具，专为实现 HTTP/2 协议而设计。它提供了协议核心逻辑的内存高效实现，包括分帧、流多路复用和流量控制。 该项目包含一个专门用于 HPACK 头部压缩和解压缩的库，以减少网络带宽。它还提供了一套用于分析网络流量和基准测试服务器性能的工具，包括吞吐量和延迟测量。 其更广泛的能力涵盖了协议实现和流量管理，包括 ALPN 连接协商、请求优先级排序以及头部组件的验证。该库通过基于回调的事件系统支持自定义协议扩展，并包含用于内存管理和错误代码转换的实用工具。 该项目包含用于为 Android 平台交叉编译二进制文件的构建支持和配置脚本。

该项目是一个用于在 Go 中构建可扩展后端系统的微服务框架。它提供了一种分布式系统架构，集成了对服务发现、负载均衡和容错机制的支持。 该框架的独特之处在于领域驱动的分层架构和远程优先的配置系统，该系统在远程存储和本地文件之间同步设置并具有自动故障转移功能。它使用 gRPC 实现高性能通信模型，用于一元和流式数据交换，以及用于管理持久客户端连接的实时通知系统。 该系统涵盖了广泛的分布式能力，包括通过熔断和限流进行的流量管理，以及通过分布式追踪、集中式日志记录和健康监控实现的观测性。它还结合了数据基础设施工具，如概率布隆过滤器、分布式锁和基于令牌的服务认证。 该项目包括对容器化 Elasticsearch 和 HBase 环境的部署支持。

This is a Python WebSocket client library designed to establish full-duplex, persistent network connections for real-time exchange of text and binary data. It functions as an asynchronous network client and a TCP socket wrapper, managing the complete lifecycle of a connection from the initial handshake to graceful closure. The implementation includes a secure WebSocket client that handles SSL/TLS encryption, certificate verification, and secure handshake protocols. It further distinguishes itself by supporting advanced connectivity options, including proxy routing via HTTP or SOCKS proxies an

This project is a comprehensive computer networking textbook and instructional resource. It serves as a technical guide for the design and implementation of network layers, protocols, and hardware architecture, covering the spectrum from physical links to application-layer protocols. The content provides a detailed study of standards for congestion control, reliable data delivery, and internetwork routing. It includes specialized technical material on network security, public-key infrastructure, and the operation of modern cloud infrastructure and data centers. The material covers a broad ra