4 个仓库
Writing techniques that use disk-based buffering to handle datasets that exceed available system memory.
Distinct from Write Throughput Optimizations: Specific to memory-saving disk flushing for large files, rather than general database write throughput optimizations.
Explore 4 awesome GitHub repositories matching data & databases · Disk-Buffered Writing. Refine with filters or upvote what's useful.
This is an open-source, crowd-sourced wiki textbook that teaches Linux system programming in C. It covers the core operating system concepts of process management through the fork-exec-wait model, dynamic memory allocation using implicit free list heap allocators, inode-based file systems, inter-process communication via pipes and shared memory, POSIX threads with synchronization primitives, signal-based asynchronous notification, virtual memory with page table translation, and runtime diagnostics using Valgrind and GDB. The textbook distinguishes itself by providing practical, implementation
Mentions splitting file content across disks for throughput as a conceptual topic.
Raspotify 是一个用于 Linux 设备的无头音频流媒体播放器,作为 Spotify Connect 客户端运行。它作为后台系统守护进程运行,使硬件能够充当可通过官方 Spotify 应用控制的无线音频接收器。 该服务专为单板计算机设计,并结合了磁盘写入最小化以减少 SD 卡磨损。它通过将音频轨道缓冲区重定向到内存文件系统来实现这一点。 该项目包括音频质量配置功能,包括比特率和采样率调整。它还通过本地令牌缓存管理身份验证,以在无需重复登录流程的情况下保持持久连接。
Reduces physical disk writes by buffering track downloads in system memory rather than on the SD card.
ipscan 是一个跨平台网络审计工具和基于 Java 的网络扫描器,用于发现联网设备并导出扫描结果。它充当 IP 地址范围扫描器和 TCP/UDP 端口扫描器,以识别网络上的活动主机和开放服务。 该应用程序具有基于插件的获取器架构,允许集成自定义数据收集获取器,以从发现的主机中检索特定的硬件或软件信息。 其更广泛的功能包括本地网络发现、网络端口审计以及网络资产清单的创建。用户可以通过具有高密度屏幕缩放功能的图形用户界面或通过用于自动化扫描的命令行界面与软件进行交互。
Implements disk-buffered writing to export large scan datasets without causing memory overflow.
XlsxWriter is a library for generating spreadsheets in the XLSX format, functioning as an Excel workbook writer and file generator. It provides the capability to write data, apply cell formatting, and build complex layouts across multiple worksheets. The project distinguishes itself with a memory-optimized writing mode that flushes large datasets to disk row-by-row, enabling the creation of files exceeding 4 GB while minimizing RAM consumption. It also includes a specialized mechanism for embedding binary project files and digital signatures to enable VBA macros and signed scripts within work
Writes extensive datasets to disk without consuming excessive RAM through a specialized memory-optimized mode.