Awesome GitHub RepositoriesBinary Serialization

Protocol Buffers is a binary serialization framework used to encode structured information into compact payloads to reduce network bandwidth and storage. It functions as a cross-language data interchange standard that enables different platforms and languages to exchange structured data using a shared schema. The project includes an interface definition language compiler that transforms schema definitions into type-safe source code for multiple target programming languages. This mechanism decouples data structures from specific language memory layouts and ensures consistent data handling acro

This library is a header-only C++ framework designed for the serialization, parsing, and manipulation of structured data. It provides a recursive variant data model that represents arbitrary structures as native types, allowing developers to navigate, modify, and patch hierarchical data using standard pointer paths and declarative update patterns. The project distinguishes itself through its template-based architecture, which enables type-safe data structures and custom type mapping at compile time. It offers a unified interface for binary format abstraction, supporting multiple compact repre

Dubbo is a Java RPC framework and microservices governance platform designed for high-performance remote procedure calls in distributed architectures. It provides the foundational components necessary to connect distributed services across a network, including a binary data serialization library and a distributed service registry. The platform distinguishes itself through a comprehensive governance suite that manages service discovery, load balancing, and traffic routing. It enables precise control over network traffic via conditional routing and a pluggable extension mechanism based on a ser

SurrealDB is a multi-model database engine designed to store and query document, graph, relational, and vector data within a single ACID-compliant platform. It functions as an AI-native data store, integrating vector search, graph traversal, and machine learning model execution directly into its query layer. By providing a unified declarative query language, the platform eliminates the need for external middleware to synchronize data across different storage models. The platform distinguishes itself through its ability to manage agent memory and complex workflows natively. It allows developer

This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha

This project provides a collection of structured, binary-encoded routing datasets designed for proxy software to automate network traffic management. By mapping domain names and IP addresses to specific functional categories, it enables proxy clients to make granular, policy-based connection decisions. The repository serves as a centralized source for routing metadata, ensuring that traffic steering logic remains consistent across various networking implementations. The project distinguishes itself through an automated aggregation pipeline that processes community-maintained datasets into a u

Telethon is a Python asynchronous API wrapper and client library designed for interacting with the Telegram API. It implements the MTProto protocol to enable programmatic communication for both user accounts and bots. The project serves as a development framework for building custom Telegram clients and automating account actions. It provides the tooling necessary to create automated bots that manage group interactions and channel communications. The library supports messaging data integration and the automation of messaging workflows. It handles the translation of high-level calls into the

Perspective is a columnar data analytics engine and high-performance visualization component powered by WebAssembly. It provides a system for analyzing and visualizing large or streaming datasets through interactive data grids and charts, utilizing a compiled binary to achieve near-native performance within the browser. The project distinguishes itself through a WebSocket-based data streaming interface and deep Apache Arrow integration, which minimize memory overhead when synchronizing tables between servers and clients. It acts as a remote query proxy capable of translating visualization con

protobuf.js is a JavaScript and TypeScript library for encoding and decoding structured data using the Protocol Buffers binary format. It functions as a dynamic parser that can load and process schemas at runtime, a JSON transcoder for converting messages to human-readable formats, and a framework for building transport-agnostic remote procedure call clients. The project distinguishes itself by offering both dynamic message handling and a static code generator that produces TypeScript declarations and JavaScript modules to reduce runtime overhead. It also provides a reflection API for definin

This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific

هذا المشروع هو تطبيق لـ Protocol Buffers بلغة Go، ويوفر إطار عمل للتسلسل الثنائي (binary serialization) لتحويل هياكل البيانات الأصلية إلى تنسيق ثنائي مضغوط لضمان كفاءة نقل البيانات وتخزينها. يعمل المشروع كمولد لروابط اللغات، حيث يستخدم إضافة للمترجم (compiler plugin) لإنشاء كود مصدر Go من تعريفات Protocol Buffers المحايدة. يتضمن التطبيق أداة لتعيين بيانات JSON تقوم بتحويل الرسائل الثنائية المهيكلة إلى تنسيق JSON لتسهيل التوافق مع خدمات الويب وواجهات برمجة التطبيقات (APIs) الخارجية. كما يتيح تبادل البيانات بين لغات مختلفة باستخدام مخطط تعريف مشترك لمشاركة البيانات المهيكلة بين لغات برمجة متنوعة. تغطي المكتبة قدرات واسعة لتسلسل البيانات وإلغاء تسلسلها، بما في ذلك القدرة على معالجة الرسائل المهيكلة عبر الاستنساخ، والدمج، والمقارنة. كما توفر آليات لفحص الرسائل بناءً على الانعكاس (reflection) ودمج الرسائل المتكرر للحفاظ على اتساق الحالة عبر الأنظمة الموزعة.

Redis is a high-performance in-memory key-value store that functions as a distributed cache, message broker, and NoSQL database. It provides sub-millisecond read and write access to data stored in RAM and can operate as a vector database for indexing high-dimensional embeddings. The system supports a wide range of data storage and synchronization primitives, including the management of strings, hashes, lists, sets, and JSON documents. It enables real-time data operations through atomic transactions, hybrid persistence using snapshots and append-only logs, and high-availability configurations

This project is a community-driven routing dataset and binary routing data compiler used to define network traffic rules. It provides a collection of categorized domain rules that direct web traffic based on site identity or location. The system converts human-readable domain lists into optimized binary formats for high-performance network filtering, specifically serving as a geosite data generator for V2Ray. It manages shared lists of domains and keywords through a collaborative repository of patterns. The toolset covers domain routing rule definition using sub-domains, full domains, keywor

Baileys is a TypeScript API client library used to interact with the WhatsApp Web API via WebSockets without requiring a browser. It functions as a real-time communication tool that handles bidirectional data exchange and event-based socket connections. The project includes a dedicated toolkit for managing WhatsApp Business profiles and product catalogs, alongside a session manager that authenticates accounts using QR codes or pairing codes and persists session state to disk. Its capabilities cover a wide range of messaging functions, including multi-type message transmission, chat history s

This repository is a comprehensive collection of functional 2D and 3D demo projects and implementation samples for the Godot Game Engine. It serves as an interactive tutorial and reference library, providing a working codebase to demonstrate how to apply engine features in real-world scenarios. The collection focuses on practical implementation guides, covering a wide array of technical capabilities from basic engine fundamentals to advanced rendering and scripting techniques. It allows users to study the application of node-based composition, asset pipelines, and game logic through direct ex

libimobiledevice is a communication library designed to interact with iOS devices using native protocols instead of proprietary software. It provides a set of tools for device management, including firmware recovery, filesystem access, and the creation of native backups and restores. The project implements a property list parser to read and write data across binary, XML, and JSON formats. It enables low-level hardware control, such as triggering recovery modes, modifying system settings, and managing device activation and provisioning via official servers. The library covers several function

Sui is a blockchain platform featuring an object-centric state model and resource-oriented smart contracts. It utilizes parallel transaction execution to increase network throughput and supports programmable transaction blocks that bundle multiple operations into single atomic units. The platform distinguishes itself with a capability-based access control system and zero-knowledge login mechanisms, enabling users to authenticate via identity providers without seed phrases. It also implements deterministic object addressing to allow predictable state lookups and supports the creation of soulbo

AppManager is a comprehensive suite of tools for managing applications on Android devices. It provides utilities for controlling application lifecycles, modifying manifests, and administering installed packages. The project distinguishes itself through deep system integration, offering capabilities to analyze and block specific application components such as activities, services, and broadcast receivers. It includes a system for saving and restoring applications along with their associated data and permissions, as well as tools for auditing and modifying runtime and development permissions.

Draco is a library and toolset for compressing, transcoding, and decoding 3D geometric meshes and point cloud data. Its primary purpose is to reduce storage size and transmission bandwidth for 3D assets. The project includes a geometry optimizer specifically for glTF file containers to reduce asset footprints. It also features a hardened decoder designed to process malformed or untrusted 3D geometric data safely to prevent memory corruption and crashes. The software covers a broad range of 3D data processing capabilities, including geometric data reconstruction, point attribute management, a

GloVe is a distributed word representation system and a C implementation for training and using Global Vectors for word embeddings. It provides a word embedding training tool to learn numerical representations of words based on global co-occurrence statistics from a text corpus. The project includes a pre-trained word vector library learned from large web datasets, allowing for the import of these representations to perform semantic analysis without local training. It enables word vector generation to identify semantic relationships, analogies, and nearest neighbors. The system covers the fu