10 repository-uri
Awesome GitHub RepositoriesIn-Memory Byte Stream Processing
Handling of binary data sequences directly in memory to avoid temporary disk storage.
Distinguishing note: Closest candidates are for network protocol parsing or DB storage, not generic memory-based file I/O.
Explore 10 awesome GitHub repositories matching operating systems & systems programming · In-Memory Byte Stream Processing. Refine with filters or upvote what's useful.
Awesome In-Memory Byte Stream Processing GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- bluenviron/mediamtx
bluenviron/mediamtx
19,226Vezi pe GitHubMediaMTX is a multi-protocol media server designed for routing, proxying, and recording real-time audio and video streams. It functions as a programmable media router and a gateway between streaming standards such as RTMP, RTSP, and WebRTC, enabling the conversion of live media between different protocols. The server distinguishes itself through on-the-fly format transmuxing and protocol-agnostic routing, which decouples input and output protocols via an internal media bus. It features a programmable automation system that executes external shell commands via event hooks triggered by client c
Distributes a single incoming media source to multiple concurrent readers via in-memory packet duplication.
Go - py-pdf/pypdf
py-pdf/pypdf
9,818Vezi pe GitHubpypdf is a Python library for parsing, manipulating, and generating PDF documents. It provides high-level operations for document processing, such as merging multiple files into one or splitting a single document into smaller files. The project includes specialized tools for managing interactive elements, including the creation and modification of annotations, hyperlinks, and form fields. It also supports advanced metadata management, allowing for the extraction and modification of standard document properties and XML-based XMP metadata. Beyond basic structural changes, the library covers pa
Performs read and write operations directly on byte sequences to bypass the need for temporary disk files.
Pythonhelp-wantedpdfpdf-documents - square/okio
square/okio
8,986Vezi pe GitHubOkio is a Java I/O library providing a set of tools for efficient byte-stream processing and file system operations. It functions as a buffered byte stream handler and streaming data transformer, utilizing a cross-platform file system API to manage data movement. The project is distinguished by its use of pooled mutable byte buffers that treat sequences as queues to reduce memory copying and garbage collection churn. It further decouples file operations from the host operating system through an abstraction-based file system, allowing for consistent path manipulation and atomic operations acro
Manages bytes as growable queues to significantly reduce memory copying and GC churn during I/O.
Kotlinkotlinkotlin-multiplatform - phoboslab/qoi
phoboslab/qoi
7,492Vezi pe GitHubQOI is a lossless image codec and encoding standard designed for high-speed compression and decompression of raw pixel data. It provides a toolkit for translating raw image buffers into a compact format and back into pixel representations without any loss of quality. The implementation focuses on fast image encoding and decoding, enabling the rapid conversion of compressed image data back into raw pixels. It also supports image format conversion to ensure compatibility across different software systems and hardware.
Implements linear byte-stream processing to avoid complex memory overhead during image encoding and decoding.
C - ctz/rustls
ctz/rustls
7,453Vezi pe GitHubrustls is a modern implementation of the Transport Layer Security protocol written in the Rust programming language. It serves as a cryptographic transport layer for establishing encrypted connections between clients and servers to ensure data privacy and integrity. The library features a pluggable crypto provider framework, allowing the substitution of cryptographic primitive implementations to meet specific platform architecture or regulatory compliance requirements. It provides capabilities for secure server configuration to handle encrypted incoming connections and secure client connecti
Implements mutable byte buffers to handle network streams and minimize memory copying.
Rust - rust-lang/rfcs
rust-lang/rfcs
6,406Vezi pe GitHubThe Rust RFCs repository is the formal home for the Rust language evolution process, housing the structured design documents and community review mechanisms that govern changes to the Rust programming language, its compiler, and its standard library. It defines the complete lifecycle for proposing, discussing, and implementing substantial changes through RFC documents, from initial submission and community feedback through final comment periods and sub-team sign-offs. The repository codifies the governance and collaboration processes that shape Rust's development, including mechanisms for com
Defines the read_exact method on the Read trait for guaranteed buffer filling.
Markdownrfcrfc-processrust - mgravell/protobuf-net
mgravell/protobuf-net
4,952Vezi pe GitHubprotobuf-net este un framework de serializare binară și o bibliotecă .NET care implementează specificația Protocol Buffers. Funcționează ca un instrument de serializare bazat pe schemă și un mapper de date contract-first, convertind grafuri complexe de obiecte într-un format binar compact pentru stocare și transmisie în rețea. Biblioteca permite schimbul de date cross-platform și rețelistica de înaltă performanță prin reducerea dimensiunilor payload-ului și a timpului de procesare. Suportă în mod specific persistența ierarhiei obiectelor, permițând serializarea și reconstrucția structurilor complexe de clase care includ moștenirea și tipurile derivate. Proiectul acoperă capabilități de bază, inclusiv serializarea și deserializarea datelor binare, generarea de clase bazată pe schemă și gestionarea moștenirii tipurilor prin identificatori unici. Oferă mecanisme pentru maparea structurilor de date prin atribute statice sau configurații dinamice de runtime.
Processes binary data directly through sequential byte streams to minimize memory overhead during large transfers.
C# - janet-lang/janet
janet-lang/janet
4,308Vezi pe GitHubJanet is a Lisp-based dynamic programming language featuring a register-based bytecode virtual machine and an embeddable scripting engine. It functions as a fiber-based concurrency runtime and includes a parsing engine based on Parsing Expression Grammars. The project is distinguished by its ability to be integrated into C or C++ applications via a minimal header interface. It utilizes a Lisp-style macro system for compile-time code transformation and employs prototype-based table inheritance for object-oriented behavior. The runtime covers a broad set of capabilities, including asynchronous
Provides growable byte buffers to store and modify sequences of bytes representing binary data.
Ccfunctional-languageimperative-language - ahupp/python-magic
ahupp/python-magic
2,886Vezi pe GitHubpython-magic is a C-binding wrapper that provides a Python interface for the libmagic system library. It functions as a file signature analyzer and MIME type detector, identifying file formats by comparing header bytes against a database of known binary signatures. The library enables the identification of file types from both file paths and raw data buffers. It supports custom file signature matching through the injection of user-provided magic databases, allowing for the detection of specialized or proprietary formats. The project covers binary data analysis and MIME type mapping to transl
Provides the ability to analyze binary data sequences directly in memory to identify file types without disk persistence.
Python - kotlin/kotlinx-io
Kotlin/kotlinx-io
1,539Vezi pe GitHubKotlinx-io is a multiplatform library designed for input and output operations, providing a unified interface for streaming data, managing byte buffers, and interacting with local filesystems. It serves as a cross-platform abstraction layer that standardizes how applications handle data movement across different operating systems and hardware architectures. The library distinguishes itself by providing high-performance tools for both mutable and immutable byte sequences. It utilizes segmented memory pools and direct memory access to minimize allocation overhead and prevent unnecessary data co
Modifies dynamic byte sequences using efficient memory segments to reduce allocation overhead.
Kotliniokotlinkotlinx
