4 Repos
Awesome GitHub RepositoriesDisk-Buffered Writing
Writing techniques that use disk-based buffering to handle datasets that exceed available system memory.
Distinct from Write Throughput Optimizations: Specific to memory-saving disk flushing for large files, rather than general database write throughput optimizations.
Explore 4 awesome GitHub repositories matching data & databases · Disk-Buffered Writing. Refine with filters or upvote what's useful.
Awesome Disk-Buffered Writing GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- angrave/systemprogramming
angrave/SystemProgramming
5,734Auf GitHub ansehenThis is an open-source, crowd-sourced wiki textbook that teaches Linux system programming in C. It covers the core operating system concepts of process management through the fork-exec-wait model, dynamic memory allocation using implicit free list heap allocators, inode-based file systems, inter-process communication via pipes and shared memory, POSIX threads with synchronization primitives, signal-based asynchronous notification, virtual memory with page table translation, and runtime diagnostics using Valgrind and GDB. The textbook distinguishes itself by providing practical, implementation
Mentions splitting file content across disks for throughput as a conceptual topic.
- dtcooper/raspotify
dtcooper/raspotify
5,154Auf GitHub ansehenRaspotify ist ein Headless-Audio-Streamer für Linux-Geräte, der als Spotify-Connect-Client fungiert. Er arbeitet als Hintergrund-System-Daemon und ermöglicht es Hardware, als drahtloser Audioempfänger zu fungieren, der über die offizielle Spotify-Anwendung steuerbar ist. Der Dienst ist für Einplatinencomputer konzipiert und beinhaltet eine Minimierung von Festplattenschreibvorgängen, um den Verschleiß von SD-Karten zu reduzieren. Dies wird erreicht, indem Audio-Track-Buffer auf ein In-Memory-Dateisystem umgeleitet werden. Das Projekt enthält Funktionen zur Konfiguration der Audioqualität, einschließlich Anpassungen von Bitrate und Samplerate. Es verwaltet zudem die Authentifizierung durch lokales Token-Caching, um persistente Verbindungen ohne wiederholte Login-Vorgänge aufrechtzuerhalten.
Reduces physical disk writes by buffering track downloads in system memory rather than on the SD card.
Shelllibrespotraspberry-piraspbian - angryip/ipscan
angryip/ipscan
5,017Auf GitHub ansehenipscan is a cross-platform network auditor and Java-based network scanner used for discovering networked devices and exporting scan results. It functions as an IP address range scanner and a TCP/UDP port scanner to identify active hosts and open services on a network. The application features a plugin-based fetcher architecture that allows the integration of custom data collection fetchers to retrieve specific hardware or software information from discovered hosts. Its broader capabilities include local network discovery, network port auditing, and the creation of network asset inventories.
Implements disk-buffered writing to export large scan datasets without causing memory overflow.
Java - jmcnamara/xlsxwriter
jmcnamara/XlsxWriter
3,911Auf GitHub ansehenXlsxWriter is a library for generating spreadsheets in the XLSX format, functioning as an Excel workbook writer and file generator. It provides the capability to write data, apply cell formatting, and build complex layouts across multiple worksheets. The project distinguishes itself with a memory-optimized writing mode that flushes large datasets to disk row-by-row, enabling the creation of files exceeding 4 GB while minimizing RAM consumption. It also includes a specialized mechanism for embedding binary project files and digital signatures to enable VBA macros and signed scripts within work
Writes extensive datasets to disk without consuming excessive RAM through a specialized memory-optimized mode.
Pythonchartslibxlsxwriterpandas
