7 个仓库
Encoding data into byte-oriented formats using match-copy logic for high-throughput reduction.
Distinct from Data Encoders: Focuses on compression encoding efficiency rather than cryptographic or serialization encoding.
Explore 7 awesome GitHub repositories matching data & databases · Byte-Oriented Block Encoding. Refine with filters or upvote what's useful.
This project provides a lossless compression algorithm and a byte-oriented compression library designed for high-speed data reduction and maximum decompression speed. It functions as a stream-oriented compression engine, a software library for encoding and decoding data blocks, and a command-line tool for managing interoperable compressed frames. The system distinguishes itself through the use of predefined pattern dictionaries to improve compression ratios for small data sets and small packets. It supports multiple processing modes, including high-speed block compression for minimal latency
Encodes data into a byte-oriented format using match-copy logic to minimize size while maintaining high throughput.
Fluent Bit 是一个云原生日志转发器和统一遥测收集器,设计为资源高效的数据流水线。它从多个来源摄取日志、指标和追踪信息,并在将数据路由到外部存储后端之前进行实时处理。 该项目作为一个实时流处理器和 OpenTelemetry 日志处理器,能够使用 SQL 和条件逻辑转换和过滤数据。它还充当分布式追踪代理,可以对追踪进行采样以减少数据量,同时保留完整的请求路径。 该系统通过基于文件系统的缓冲和有状态重试逻辑提供可靠的数据交付,以防止停机期间的数据丢失。其模块化架构支持可插拔的输入和输出插件、元数据驱动的路由,以及通过共享库扩展功能的能力。 该软件可以作为容器部署在不同的 CPU 架构和操作系统上。
Serializes and encodes processed telemetry data into specific binary or text protocols for remote delivery.
Encodes audio data directly into byte buffers without intermediate disk writes.
Libation is a comprehensive audiobook management system designed to download, decrypt, and organize Audible audiobooks. It integrates account authentication, library synchronization, DRM removal, and format transcoding into a single desktop application with a plugin-free graphical interface and a built-in theme editor. The project distinguishes itself through a batch library synchronization engine that scans all configured Audible accounts in one pass, a metadata tag rewriting system that corrects chapter markers and cover art after decryption, and a template-based file naming engine that con
Transcodes audiobooks from multiple formats to MP3 for broader player compatibility.
This is a cross-platform media processing library that reads, writes, encodes, and decodes media in both browser and server environments. It supports common container formats including ISOBMFF, Matroska, Ogg, MPEG-TS, and HLS, and handles codec operations through a combination of WebCodecs API and WebAssembly-based encoders. Media is processed in streaming pipelines that maintain constant memory usage and automatically apply backpressure from output speed to all upstream components. The library distinguishes itself through a plugin-based codec registration system that allows extending support
Encodes audio to FLAC lossless format using a WebAssembly-based encoder.
Cellnet 是一个 Go 网络框架,专为构建分布式系统和点对点网络而设计。它提供了一个多协议传输层,标准化了 TCP、UDP 和 WebSocket 之间的消息交换,并利用二进制消息编解码系统将消息类型映射到网络传输的唯一标识符。 该框架的特色在于其远程过程调用(RPC)库,它支持使用同步或异步请求模式在远程对等点上执行函数。它还通过异步事件调度器进一步区分,该调度器通过顺序执行模型处理网络回调,以管理并发性和线程安全。 其更广泛的功能包括通过可插拔序列化编解码器进行自定义网络协议开发、带有会话跟踪和重连逻辑的自动化对等点连接管理,以及用于引导网络流量的基于处理器的路由系统。它还集成了用于监控对等点健康状况、记录网络流量以及通过 HTTP 提供文件服务的工具。
Supports the use of multiple encoding schemes within a single session for network message serialization.
Rueidis is a high-performance Redis client library for Go that provides a type-safe and asynchronous interface for interacting with Redis servers. It includes a full implementation of the Redis serialization protocol and a dedicated connection manager to handle pooling, multiplexing, and automatic pipelining. The library is distinguished by its support for RDMA connectivity to reduce latency and CPU overhead. It features a distributed lock manager that implements majority-based locking and optimistic concurrency control, as well as client-side caching with invalidation signals to minimize net
Implements the encoding of complex data structures into compliant byte sequences for Redis transmission.