54 रिपॉजिटरी
Compact, machine-readable wire-level specifications that prioritize performance and schema evolution over human readability.
Explore 54 awesome GitHub repositories matching data & databases · Binary Serialization Protocols. Refine with filters or upvote what's useful.
SecLists is a centralized library of security assessment data designed to support vulnerability discovery and penetration testing. It functions as a comprehensive repository of wordlists, payloads, and testing methodologies used to audit software, firmware, and internet-connected hardware for technical vulnerabilities. The project distinguishes itself through a standardized taxonomy and a language-agnostic data format, which allows security tools to predictably ingest and utilize its assets regardless of the underlying programming environment. By decoupling raw testing data from execution log
Uses a language-agnostic, raw character data format for payloads and wordlists.
Protocol Buffers is a binary serialization framework used to encode structured information into compact payloads to reduce network bandwidth and storage. It functions as a cross-language data interchange standard that enables different platforms and languages to exchange structured data using a shared schema. The project includes an interface definition language compiler that transforms schema definitions into type-safe source code for multiple target programming languages. This mechanism decouples data structures from specific language memory layouts and ensures consistent data handling acro
Implements the Protocol Buffers binary format for language-neutral, platform-agnostic serialization of structured data.
Protocol Buffers संरचित डेटा को क्रमबद्ध (serialize) करने के लिए एक भाषा-तटस्थ, प्लेटफ़ॉर्म-अज्ञेयवादी तंत्र है। यह एक स्कीमा-संचालित टूलचेन प्रदान करता है जो घोषणात्मक डेटा परिभाषाओं को टाइप-सेफ सोर्स कोड में संकलित करता है, जिससे विभिन्न प्रोग्रामिंग भाषाओं में लिखी गई सेवाओं के बीच सुसंगत संचार और दृढ़ता से टाइप किए गए API अनुबंध सक्षम होते हैं। प्रोजेक्ट एक अत्यधिक कुशल बाइनरी वायर प्रारूप के माध्यम से खुद को अलग करता है जो पेलोड आकार और प्रसंस्करण ओवरहेड को कम करने के लिए टैग-आधारित एन्कोडिंग और वेरिएबल-विड्थ पूर्णांक संपीड़न का उपयोग करता है। यह मजबूत विकासवादी स्कीमा प्रबंधन का समर्थन करता है, जिससे डेवलपर्स को बैकवर्ड और फॉरवर्ड संगतता बनाए रखते हुए डेटा संरचनाओं को वृद्धिशील रूप से अपडेट करने की अनुमति मिलती है। यह एक वर्शन्ड एडिशन सिस्टम द्वारा समर्थित है जो वितरित सॉफ्टवेयर घटकों में फीचर सेट और सीरियलाइज़ेशन तर्क का प्रबंधन करता है। अपने मुख्य बाइनरी सीरियलाइज़ेशन से परे, प्रोजेक्ट में स्कीमा सत्यापन के साथ कैनोनिकल JSON रूपांतरण, दानेदार प्रतीक दृश्यता नियंत्रण, और डिफ़ॉल्ट और अनसेट मानों के बीच अंतर करने के लिए फ़ील्ड उपस्थिति ट्रैकिंग की क्षमताएं शामिल हैं। यह जटिल संदेश पेड़ों के निर्माण और सफाई के दौरान प्रदर्शन को बेहतर बनाने के लिए C++ कार्यान्वयन के लिए एरिना-आधारित मेमोरी प्रबंधन जैसे विशेष अनुकूलन भी प्रदान करता है।
Delivers a compact, platform-agnostic format for serializing structured information across diverse computing environments.
This project is a comprehensive, community-maintained knowledge base and toolkit designed for competitive programming. It serves as a centralized repository for algorithmic theory, data structures, and mathematical techniques, providing a structured reference for informatics and collegiate programming competitions. The project distinguishes itself by integrating educational content with a robust suite of automation utilities. It provides a complete workflow for competitive programming, including tools for automated test case generation, solution verification, and direct interaction with onlin
Compresses complex problem states into integer representations to reduce memory usage and computational complexity in dynamic programming.
Kratos is a toolkit for building cloud-native microservices in Go. It provides a comprehensive suite of framework primitives, including a dedicated toolset for API-first development using Protobuf to generate server and client code for gRPC and HTTP. The project is distinguished by its pluggable service infrastructure, which allows for the swapping of configuration stores, service registries, and data encoding formats. It utilizes a composable middleware pipeline to inject cross-cutting concerns such as authentication, request validation, and circuit breaking into the service flow. The frame
Analyzes Protobuf files for breaking changes and style violations to ensure backward compatibility.
ONNX is an open-source standard for machine learning interoperability that provides a unified format for representing neural network models. By defining a common set of operators and a standardized file structure, it enables models to be shared, exported, and executed consistently across different training frameworks and software ecosystems. The project functions as an intermediate representation layer that decouples model development from deployment. It utilizes a language-neutral binary serialization format to store model structures and weights, ensuring that computational graphs remain por
Utilizes a language-neutral binary serialization format to store model structures and weights for cross-platform interoperability.
This project is a pure JavaScript database driver for Node.js that implements the native MySQL binary protocol. It serves as a comprehensive connector for managing persistent network links to MySQL servers, enabling applications to execute queries, manage transactions, and handle complex data operations without requiring external middleware. The driver distinguishes itself through its integrated support for connection pooling and distributed database routing. It maintains managed sets of reusable network sockets to optimize resource usage under high request volumes, while simultaneously provi
Communicates directly with the database server using its binary wire protocol to eliminate the need for external middleware.
MMKV is a high-performance, cross-platform key-value storage framework designed for mobile platforms and POSIX environments, including Android, iOS, macOS, and Windows. It provides a persistence layer that utilizes memory-mapped files and binary serialization to achieve low-latency data access. The project distinguishes itself through native support for multi-process synchronization, allowing concurrent read and write operations across different application processes. It also implements security via AES encryption for data at rest, featuring symmetric encryption and key rotation to protect st
Uses a binary Protocol Buffer format to encode key-value pairs for compact disk representation.
This project is a cross-platform managed execution environment and general-purpose application framework designed for building high-performance software. It provides a unified runtime that handles memory management, type safety, and code execution across diverse operating systems. By integrating a native code compilation toolchain, the platform enables developers to convert managed code into optimized machine instructions, significantly improving startup performance and reducing runtime dependencies for production environments. The framework distinguishes itself through a comprehensive toolch
Implements high-performance binary serialization for efficient data exchange in distributed systems.
brpc is a high-performance C++ RPC framework and network programming library designed for building distributed systems. It functions as a multi-protocol RPC server capable of hosting and detecting multiple communication protocols, including gRPC, Thrift, HTTP, Redis, and Memcached, on a single TCP port. The project distinguishes itself through high-throughput data transport and memory efficiency, utilizing RDMA-based transport to bypass the kernel TCP stack and zero-copy memory management to eliminate data duplication. It also implements the Raft algorithm for consensus-based state replicatio
Transmits requests and responses using the Protocol Buffers wire format for efficient binary communication.
This project is a database driver for Node.js applications designed to interface with Redis. It provides structured access to data stores, enabling the execution of commands, management of data structures, and the implementation of atomic transaction processing. The client distinguishes itself through native support for the binary-safe serialization protocol and a promise-based command pipeline that groups operations to minimize latency. It includes a dedicated manager for distributed environments that handles node discovery and request routing, alongside an event-driven messaging system that
Exchanges data using a modern binary-safe protocol to ensure accurate type mapping and efficient communication.
This project is a high-performance, distributed API gateway designed to manage, secure, and observe traffic for microservices, serverless functions, and artificial intelligence model providers. It functions as a dynamic service proxy and cloud-native ingress controller, centralizing policy enforcement and traffic routing through a unified configuration interface that synchronizes state across multiple nodes in real time. The platform distinguishes itself through a highly extensible architecture that utilizes a high-performance scripting engine to execute modular logic directly within the requ
Stores and manages binary serialization definitions to facilitate communication and transcoding for high-performance remote procedure call services.
Arrow is a cross-language development platform for in-memory data. It provides a standardized, language-independent columnar memory format designed to accelerate analytical operations and improve memory efficiency on modern computing hardware. By utilizing a schema-driven approach, the framework enables the efficient organization of both flat and nested data structures. The project functions as an analytical data processing engine that facilitates high-performance computation directly on memory-resident datasets. It distinguishes itself through a zero-copy architecture, which allows multiple
Provides a framework for moving large datasets between systems using shared memory to eliminate serialization overhead.
This project is a native Go driver for the MySQL protocol, providing a communication layer that enables applications to interact with relational database management systems. It implements the standard database interface, allowing developers to manage persistent connections, execute queries, and handle transactions within their applications. The driver functions by translating high-level database commands into the specific binary packet format required for communication with MySQL servers. It manages network sessions through a connection pooling mechanism and supports context-aware query cance
Translates high-level database commands into specific binary packet formats for efficient server communication.
Jedis is a Java library for connecting to Redis servers to execute commands and manage key-value data structures. It serves as a Java client and connection manager that facilitates the storage and retrieval of high-performance data. The project provides a cluster client for distributing data and requests across multiple nodes to ensure scaling and high availability. It includes a dedicated pub-sub client for real-time messaging through channel subscriptions and a pipelining tool to increase throughput by sending multiple commands in a single network round-trip. The library covers a broad ran
Serializes Java method calls into the RESP binary format for low-latency server communication.
Awesome-adb is a curated collection of resources and utilities designed for interacting with Android devices via the command line. It serves as a comprehensive toolkit for developers and system administrators to facilitate the development, testing, and maintenance lifecycle of mobile applications and system software. The project provides a centralized reference for leveraging the Android Debug Bridge to perform complex tasks, including mobile automation, system-level debugging, and device fleet management. It covers a wide range of capabilities such as simulating user input for stress testing
Encodes commands into a structured binary format for efficient transmission and reliable parsing by the target device.
This project provides a comprehensive collection of English vocabulary designed for programmatic access, dictionary lookups, and linguistic research. It serves as a structured repository of words formatted for integration into software development tasks, including natural language processing and text analysis. The dataset is distributed as static, schema-less files in plain text and universal serialization formats. This approach allows the vocabulary to be consumed by any programming language or runtime environment without requiring external dependencies or complex indexing. The repository s
Encodes word lists in universal formats like JSON and plain text for cross-language consumption.
gRPC Java is a library for building distributed systems that enables client and server applications to interact through remote procedure calls. It uses protocol buffers to define service interfaces and exchange structured data, providing a framework for connecting microservices across different environments. The framework utilizes an asynchronous networking foundation to manage concurrent connections and relies on a multiplexed binary protocol to facilitate efficient data exchange. It supports pluggable transport interceptors, allowing for the injection of custom logic into the request-respon
Uses protocol buffers to define service interfaces and generate strongly-typed client and server stubs.
Pomelo is a distributed Node.js game server framework designed for building scalable multiplayer game backends and real-time web applications. It employs a multi-process architecture to distribute application logic horizontally across a cluster of machines, enabling high concurrency and balanced network traffic. The framework utilizes a WebSocket communication layer to manage bidirectional data exchange between diverse web clients and server clusters. It incorporates a remote procedure call system for triggering functions across remote server processes and uses Protocol Buffers for binary ser
Utilizes a compact binary format for serializing structured data between clients and servers.
Buf is a toolchain for managing the full lifecycle of Protocol Buffers schemas. It provides a set of tools for schema governance, including linting to enforce style guides, a breaking change detector to ensure backward compatibility, and a system for producing language-specific source code via local or remote plugins. The project distinguishes itself through a remote schema registry that centralizes the hosting, versioning, and distribution of Protocol Buffers modules. This registry allows for server-side enforcement of governance policies, such as blocking updates that introduce backward-inc
Provides a central repository for managing the lifecycle and distribution of Protocol Buffer schemas.