28 repositorios
Use of protocol buffers for efficient binary serialization and cross-language data communication.
Distinct from Serialization Protocols: Existing candidates focus on JSON mapping or raw buffers, not the general use of Protobuf for distributed node communication
Explore 28 awesome GitHub repositories matching data & databases · Protobuf Serialization. Refine with filters or upvote what's useful.
Hyperledger Fabric is a permissioned blockchain framework and enterprise blockchain platform designed for maintaining shared, immutable records of transactions across a network of authorized participants. It provides the infrastructure to build and manage private distributed ledgers that prioritize data confidentiality and scalability. The platform is distinguished by a modular architecture and a pluggable consensus engine. This design allows internal system implementations to be swapped with custom modules to adapt the ledger's behavior and consensus mechanisms to specific technical or indus
Uses protocol buffers to generate source code for consistent data communication and serialization between nodes.
grpcurl is a command-line interface and client tool for invoking gRPC methods and inspecting service definitions. It serves as a server debugger and reflection client, allowing users to call remote procedures and verify server responses from the terminal using JSON or protobuf formats. The tool distinguishes itself through the ability to discover available services and methods dynamically via a server reflection service or by loading local protobuf schema files. It can extract service descriptions from a server for local use and print specific schema symbol definitions. It covers a broad ran
Ships a tool to list services and describe protobuf message structures using server reflection or local files.
grpc-rust is a native gRPC framework for Rust designed for building high-performance remote procedure call clients and servers. It provides an asynchronous communication stack and a protocol buffers implementation for encoding, decoding, and generating type-safe code from service definitions. The project enables the implementation of unary and bi-directional data streaming over the HTTP/2 protocol. It includes specialized support for gRPC-Web integration, allowing browser-based clients to communicate with services through protocol translation. The infrastructure covers a broad range of distr
Uses protocol buffers for efficient binary serialization and deserialization of messages.
Pomelo is a distributed Node.js game server framework designed for building scalable multiplayer game backends and real-time web applications. It employs a multi-process architecture to distribute application logic horizontally across a cluster of machines, enabling high concurrency and balanced network traffic. The framework utilizes a WebSocket communication layer to manage bidirectional data exchange between diverse web clients and server clusters. It incorporates a remote procedure call system for triggering functions across remote server processes and uses Protocol Buffers for binary ser
Uses Protocol Buffers to compress message payloads into a compact binary format.
protobuf.js is a JavaScript and TypeScript library for encoding and decoding structured data using the Protocol Buffers binary format. It functions as a dynamic parser that can load and process schemas at runtime, a JSON transcoder for converting messages to human-readable formats, and a framework for building transport-agnostic remote procedure call clients. The project distinguishes itself by offering both dynamic message handling and a static code generator that produces TypeScript declarations and JavaScript modules to reduce runtime overhead. It also provides a reflection API for definin
Imports service descriptors via reflection, source files, or binary sets to define message structures.
RoadRunner is a high-performance application server and process manager designed to serve PHP applications using a persistent worker model. It eliminates bootload overhead and initialization time by keeping application processes alive between requests, acting as a protocol-agnostic proxy that routes traffic to a pool of supervised workers. The server is built with a plugin-based modular architecture, allowing it to be extended with custom Go plugins and compiled into tailored binaries. It distinguishes itself by providing a unified execution model for a wide array of communication protocols,
Allows the retrieval of shared protobuf definitions at runtime for handling dynamic messages.
pysc2 es una interfaz de Python y un framework de simulación que conecta el motor del juego StarCraft II con agentes de aprendizaje automático. Actúa como un envoltorio de API que expone los componentes internos del juego como un conjunto de observaciones y acciones, proporcionando un entorno de aprendizaje por refuerzo para la investigación y el entrenamiento. El framework incluye herramientas para el análisis de repeticiones de juegos para extraer datos y secuencias de acciones de partidas grabadas para el modelado predictivo. También proporciona un entorno de simulación de agentes para ejecutar y evaluar el rendimiento de agentes de inteligencia artificial individuales o competitivos. El sistema maneja la configuración del mapa del juego, el análisis de comportamiento y proporciona una interfaz de control manual para depurar el comportamiento del agente. Transforma el estado del juego en tensores multidimensionales y utiliza un framework de llamada a procedimiento remoto para gestionar la comunicación entre el cliente y el motor del juego.
Uses Protocol Buffers to serialize observations and actions for consistent, strictly typed cross-language data transfer.
tensorboardX is a machine learning experiment tracking library used to log metrics and visual data from training processes. It enables the creation of event files that store scalars, images, audio, and graphs for monitoring model performance and behavior. The project provides framework-agnostic logging, allowing users to write visualization data from PyTorch, NumPy, or Chainer. It decouples data recording from specific deep learning engines by using a standardized set of writers to generate binary protobuf files. The library supports model visualization and training data analysis, including
Uses protocol buffers to ensure cross-platform compatibility between the logging library and the visualization viewer.
This project is an embedded operating system for creating decentralized peer-to-peer communication networks using long-range radio hardware. It provides an off-grid messaging protocol for transmitting text and GPS coordinates without relying on cellular or internet infrastructure. The firmware implements a secure communication framework using shared keys and high-grade encryption to protect data transmitted over the air. It includes a LoRaWAN hardware interface to manage radio parameters and an MQTT radio gateway to bridge local mesh traffic to external networks. The system covers a broad ra
Utilizes Protobuf for compact binary serialization to optimize message transmission over low-bandwidth radio links.
Twirp es un framework RPC de Protocol Buffers diseñado para implementar la comunicación de microservicios distribuidos con tipado fuerte sobre HTTP. Funciona como un framework de comunicación de microservicios y generador de código de API que produce stubs de cliente e interfaces de servidor fuertemente tipados a partir de definiciones de esquema para eliminar el boilerplate de red manual. El framework garantiza la compatibilidad con la infraestructura web existente ejecutando llamadas a procedimientos remotos sobre transporte HTTP estándar. Utiliza contratos basados en esquemas como una única fuente de verdad para permitir la interoperabilidad entre lenguajes y desacoplar la lógica de negocio del transporte de red. El sistema cubre varias áreas de capacidad principales, incluyendo el enrutamiento basado en interfaces, la serialización de datos en múltiples formatos (JSON y binario) y middleware para el ciclo de vida de las solicitudes para preocupaciones transversales. También proporciona un sistema de mapeo de errores estandarizado para traducir fallos de servicio en códigos legibles por máquina e incluye herramientas para la verificación de compatibilidad del cliente.
Supports both JSON and binary serialization to match client requirements and optimize data exchange.
Loads game configuration and content from spreadsheet formats using custom schema definitions.
TensorFlow Serving is a high-performance machine learning inference server designed to deploy TensorFlow models to production environments. It functions as a complete serving system that executes predictions on input data through a graph executor, providing network endpoints that eliminate the need for a separate runtime environment for client applications. The system is distinguished by its model version manager, which organizes and selects specific model versions within a directory hierarchy. It uses a filesystem watcher to detect new model versions and trigger automatic updates without int
Uses protocol buffers to define strict input and output signatures for efficient data exchange between clients and models.
yolotf es un framework de detección de objetos que proporciona herramientas para convertir configuraciones y pesos de modelos de Darknet a grafos de TensorFlow. Incluye un entrenador de modelos de TensorFlow para entrenar nuevos modelos de detección o ajustar pesos existentes utilizando datasets personalizados. El proyecto cuenta con un exportador de modelos móviles que serializa definiciones de grafos y metadatos en archivos protobuf para su despliegue en dispositivos móviles. El framework soporta inferencia de detección de objetos en imágenes y video para identificar objetos y exportar coordenadas de cajas delimitadoras. Gestiona el estado del modelo mediante la traducción de mapeo de pesos y entrenamiento basado en puntos de control para permitir la restauración de pesos y estados del optimizador.
Serializes trained model graphs and metadata into protobuf files for mobile deployment.
grpcui es una interfaz web interactiva basada en navegador y cliente de API para ejecutar llamadas a procedimientos remotos (RPC) a servidores gRPC. Funciona como un gateway de HTTP a gRPC que traduce payloads JSON en mensajes binarios protobuf, permitiendo a los usuarios activar solicitudes de red e inspeccionar respuestas a través de una interfaz web visual. La herramienta proporciona capacidades de exploración y descubrimiento de esquemas consultando la reflexión del servidor o cargando archivos descriptores protobuf locales para identificar servicios disponibles y firmas de métodos. Utiliza estas definiciones para generar automáticamente formularios de entrada dinámicos para construir datos de solicitud, incluyendo soporte para estructuras anidadas complejas. El proyecto cubre pruebas de API y depuración de clientes, permitiendo la revisión de cuerpos de respuesta, códigos de estado y encabezados de metadatos. También gestiona la conectividad segura a través de una capa de transporte que admite texto plano, TLS y autenticación mutua con certificados de cliente configurables.
Resolves communication endpoints by loading service definitions from server reflection, source files, or binary descriptors.
CloudEvents is an open specification for describing event data in a common format across cloud platforms and services. It defines a standard structure and set of metadata attributes for events, enabling interoperability across different systems so producers and consumers can exchange events without custom translation. The specification provides a protocol-agnostic serialization framework that maps CloudEvents attributes and payloads to multiple serialization formats including JSON, Avro, and Protobuf, and defines transport bindings for mapping events onto protocols like HTTP, AMQP, Kafka, MQTT
Supports string, binary, and protobuf message payloads within a CloudEvent envelope.
stc is a TypeScript type checker implemented entirely in Rust, designed to validate type correctness in TypeScript source code with native performance and memory safety. It operates as a no-emitting type validator, meaning it checks types only and does not produce JavaScript output, reducing overhead compared to a full compiler. The checker is built around a zero-false-positive design, reporting only errors that are provably certain from the type system, prioritizing correctness over speculative warnings. The tool distinguishes itself through parallel file processing, analyzing source files c
Loads and processes typing packages that use namespaces and globals.
CRI-O is an open-source container runtime that implements the Kubernetes Container Runtime Interface (CRI) to manage container images, pods, and containers on cluster nodes using OCI-compatible runtimes. It serves as a node-level container manager that handles image pulling, container lifecycle, and resource monitoring for Kubernetes clusters, running containers according to the Open Container Initiative specifications. The runtime distinguishes itself through live configuration reloading that applies changes to runtime definitions, registry mirrors, and TLS certificates without restarting th
Prevents panics when serializing ListContainer and ListPodSandbox responses using protocol buffers.
Perfetto is a platform for system-level performance tracing and analysis on Linux and Android. It combines a high-throughput trace recorder, a SQL-based query engine, and a browser-based visualizer into a single toolchain. The platform covers CPU scheduling and call-stack profiling, native and Java heap memory allocation tracking, GPU and graphics events, and system-wide counters such as CPU frequency and power consumption. The architecture decouples trace recording from offline analysis, using a compact protobuf format for event encoding and columnar storage for efficient SQL queries. The we
Encodes trace events in a compact, extensible binary format using Protocol Buffers.
ServiceStack es un framework web de alto rendimiento para .NET diseñado para construir APIs con seguridad de tipos utilizando objetos de solicitud y respuesta fuertemente tipados. Funciona como un motor de API basado en mensajes que desacopla la lógica de negocio de la capa de transporte, permitiendo que los servicios se expongan a través de múltiples protocolos, incluyendo HTTP, gRPC y varios proveedores de colas de mensajes. El framework se distingue por su generador de API con seguridad de tipos, que produce SDKs de cliente nativos y objetos de transferencia de datos (DTOs) a partir de metadatos de servicio en múltiples lenguajes. También incluye un gateway de servicios distribuidos para la orquestación de microservicios, un ORM code-first para traducir objetos C# directamente a registros de base de datos y un sistema centralizado de gestión de identidad y acceso para un acceso seguro basado en tokens. Su superficie de capacidades más amplia cubre la mensajería asíncrona y el streaming de eventos en tiempo real mediante Pub-Sub y Server-Sent Events. Proporciona un soporte integral de serialización de datos para formatos como JSON, XML, ProtoBuf y MessagePack, junto con flujos de autenticación integrados que incluyen JWT, claves API y autenticación de paso a paso. Herramientas adicionales incluyen la generación automatizada de API CRUD, ejecución de trabajos en segundo plano y plantillas de dashboard administrativo.
Utilizes protocol buffers to transmit data in a compact binary wire format for high-performance serialization.
Valhalla is an open-source routing engine that calculates optimal paths and travel times using OpenStreetMap data. It is built around a tiled routing graph framework, allowing map data to be organized into small geographic tiles for efficient regional updates and offline routing capability. The project distinguishes itself through a multimodal routing server that combines automobile, pedestrian, bicycle, and public transit modes into single journeys. It includes a GPS trace matching engine to align noisy coordinates to the most probable road network paths and an isochrone and matrix generator
Generates protocol buffer files from route requests to provide consistent input for pinpoint testing.