7 repositorios
Encoding data into byte-oriented formats using match-copy logic for high-throughput reduction.
Distinct from Data Encoders: Focuses on compression encoding efficiency rather than cryptographic or serialization encoding.
Explore 7 awesome GitHub repositories matching data & databases · Byte-Oriented Block Encoding. Refine with filters or upvote what's useful.
This project provides a lossless compression algorithm and a byte-oriented compression library designed for high-speed data reduction and maximum decompression speed. It functions as a stream-oriented compression engine, a software library for encoding and decoding data blocks, and a command-line tool for managing interoperable compressed frames. The system distinguishes itself through the use of predefined pattern dictionaries to improve compression ratios for small data sets and small packets. It supports multiple processing modes, including high-speed block compression for minimal latency
Encodes data into a byte-oriented format using match-copy logic to minimize size while maintaining high throughput.
Fluent Bit es un recolector de logs y telemetría unificado, nativo de la nube, diseñado como un pipeline de datos eficiente en recursos. Ingiere logs, métricas y trazas de múltiples fuentes, procesándolos en tiempo real antes de enrutar los datos a backends de almacenamiento externos. El proyecto funciona como un procesador de flujos en tiempo real y procesador de logs de OpenTelemetry, capaz de transformar y filtrar datos utilizando SQL y lógica condicional. También actúa como un agente de rastreo distribuido que puede muestrear trazas para reducir el volumen de datos mientras preserva las rutas completas de las solicitudes. El sistema proporciona una entrega de datos fiable mediante almacenamiento en búfer respaldado por el sistema de archivos y lógica de reintento con estado para evitar la pérdida de datos durante interrupciones. Su arquitectura modular admite plugins de entrada y salida conectables, enrutamiento basado en metadatos y la capacidad de extender la funcionalidad mediante bibliotecas compartidas. El software puede desplegarse como un contenedor a través de diferentes arquitecturas de CPU y sistemas operativos.
Serializes and encodes processed telemetry data into specific binary or text protocols for remote delivery.
Encodes audio data directly into byte buffers without intermediate disk writes.
Libation is a comprehensive audiobook management system designed to download, decrypt, and organize Audible audiobooks. It integrates account authentication, library synchronization, DRM removal, and format transcoding into a single desktop application with a plugin-free graphical interface and a built-in theme editor. The project distinguishes itself through a batch library synchronization engine that scans all configured Audible accounts in one pass, a metadata tag rewriting system that corrects chapter markers and cover art after decryption, and a template-based file naming engine that con
Transcodes audiobooks from multiple formats to MP3 for broader player compatibility.
This is a cross-platform media processing library that reads, writes, encodes, and decodes media in both browser and server environments. It supports common container formats including ISOBMFF, Matroska, Ogg, MPEG-TS, and HLS, and handles codec operations through a combination of WebCodecs API and WebAssembly-based encoders. Media is processed in streaming pipelines that maintain constant memory usage and automatically apply backpressure from output speed to all upstream components. The library distinguishes itself through a plugin-based codec registration system that allows extending support
Encodes audio to FLAC lossless format using a WebAssembly-based encoder.
Cellnet is a Go networking framework designed for building distributed systems and peer-to-peer networks. It provides a multi-protocol transport layer that standardizes message exchange across TCP, UDP, and WebSockets, utilizing a binary message codec system to map message types to unique identifiers for network transmission. The framework is distinguished by its remote procedure call library, which enables the execution of functions on remote peers using synchronous or asynchronous request patterns. It further differentiates itself with an asynchronous event dispatcher that processes network
Supports the use of multiple encoding schemes within a single session for network message serialization.
Rueidis is a high-performance Redis client library for Go that provides a type-safe and asynchronous interface for interacting with Redis servers. It includes a full implementation of the Redis serialization protocol and a dedicated connection manager to handle pooling, multiplexing, and automatic pipelining. The library is distinguished by its support for RDMA connectivity to reduce latency and CPU overhead. It features a distributed lock manager that implements majority-based locking and optimistic concurrency control, as well as client-side caching with invalidation signals to minimize net
Implements the encoding of complex data structures into compliant byte sequences for Redis transmission.