5 dépôts
Systems that utilize pre-allocated memory buffers to optimize sequential data throughput.
Explore 5 awesome GitHub repositories matching data & databases · Buffered Stream Processors. Refine with filters or upvote what's useful.
ripgrep is a command-line utility designed for searching through large file trees and source code repositories. It functions as a recursive text processor that traverses directories to locate and display matching patterns, serving as a high-performance alternative to traditional search tools. The tool distinguishes itself through a focus on execution speed and intelligent file handling. It utilizes a finite automata-based regular expression engine to ensure linear time complexity and employs hardware-level acceleration for literal byte sequence scanning. By integrating with version control sy
Buffers sequential data in large chunks to maintain high performance during extensive file system reads.
Etcher is a disk image writer and operating system flashing tool used to create bootable USB drives and SD cards. It transfers binary system images to physical external media, enabling computers or microcontrollers to boot from the prepared storage. The application includes system drive protection to prevent the accidental erasure of internal hard drives by filtering available storage devices based on metadata. It also performs data verification by comparing written bytes against the source image to ensure no corruption occurred during the flashing process.
Implements buffered stream processing to handle large system images without exhausting system memory.
This project is a native Go driver for the MySQL protocol, providing a communication layer that enables applications to interact with relational database management systems. It implements the standard database interface, allowing developers to manage persistent connections, execute queries, and handle transactions within their applications. The driver functions by translating high-level database commands into the specific binary packet format required for communication with MySQL servers. It manages network sessions through a connection pooling mechanism and supports context-aware query cance
Utilizes reusable memory buffers to process incoming network streams and minimize garbage collection pressure during large result set retrieval.
Hexyl is a colored hex dump utility and binary data viewer for the terminal. It allows for the inspection of binary files by rendering contents as a colored hex dump to distinguish between different byte categories, such as printable text, whitespace, and null bytes. The tool includes a C-style hex exporter that transforms binary data into C include files for direct integration into source code. It supports visual layout customization through configurable panels and borders, as well as the ability to define colors for byte categories and offsets using terminal colors or RGB hex codes via envi
Implements buffered stream processing to efficiently handle large binary files without exhaustive memory consumption.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Implements a buffered bulk processor that flushes index operations based on item count or time intervals.