2 个仓库
Awesome GitHub RepositoriesDisk IO Optimization
Techniques for minimizing data movement between kernel and application during persistence operations.
Distinct from Zero-Copy: Distinct from serialization zero-copy by focusing on the physical disk I/O path rather than memory layout.
Explore 2 awesome GitHub repositories matching data & databases · Disk IO Optimization. Refine with filters or upvote what's useful.
Awesome Disk IO Optimization GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- infinyon/fluvio
infinyon/fluvio
5,231在 GitHub 上查看Fluvio is a distributed event streaming platform and cloud-native streaming engine designed for collecting, persisting, and replicating real-time data streams across a distributed cluster. It functions as a real-time data pipeline for building stateful workflows that ingest, enrich, and export data between external sources and sinks. The platform is distinguished by its use of WebAssembly to execute compiled modules for in-line data transformations and filtering. This allows for the execution of custom business logic to reshape information in motion without requiring a restart of the cluster.
Implements zero-copy disk IO to persist immutable event records while minimizing memory copying overhead.
Rust - axboe/liburing
axboe/liburing
3,690在 GitHub 上查看liburing is a C library that provides a low-level wrapper for the Linux kernel io_uring interface. It serves as a programming interface for executing non-blocking disk and network operations and abstracts the system calls required to communicate with the Linux kernel. The library focuses on reducing system call overhead and context switching for high-throughput data processing. It implements mechanisms for shared ring buffers, zero-copy buffer registration, and fixed-file descriptor mapping to minimize internal lookup and reference counting overhead. The project covers asynchronous input and
Provides asynchronous disk I/O operations to maximize throughput and prevent application blocking on hardware latency.
C
