Awesome GitHub RepositoriesWrite Throughput Optimizations

LevelDB is an embedded database library and persistent storage engine that provides a sorted key-value store. It uses a log-structured merge-tree architecture to map byte arrays to values, running directly within a process to provide storage without the need for a separate server process. The system is distinguished by its use of custom comparison functions to define key ordering, enabling efficient range scans and sequenced lookups. It ensures data reliability through atomic batch execution, consistent snapshot generation, and log-based recovery after failures. The engine covers broad capab

MMKV is a high-performance, cross-platform key-value storage framework designed for mobile platforms and POSIX environments, including Android, iOS, macOS, and Windows. It provides a persistence layer that utilizes memory-mapped files and binary serialization to achieve low-latency data access. The project distinguishes itself through native support for multi-process synchronization, allowing concurrent read and write operations across different application processes. It also implements security via AES encryption for data at rest, featuring symmetric encryption and key rotation to protect st

rqlite is a distributed relational database that replicates SQLite data across a cluster using the Raft consensus algorithm. It functions as a fault-tolerant storage system that provides high availability and a web API for executing SQL queries and managing relational data without requiring native database drivers. The system distinguishes itself by using an HTTP SQL interface to expose database operations and cluster management. It features a real-time change data capture stream that pushes database mutations to external HTTP endpoints via webhooks and supports the scaling of read throughput

FoundationDB is an ACID-compliant distributed transactional key-value store. It functions as a scalable database engine that ensures strict serializability and data consistency across a cluster of servers using a shared-nothing architecture. The system is distinguished by its multi-region replication capabilities, allowing data to be synchronized across different datacenters for high availability and disaster recovery. It utilizes optimistic concurrency control to manage distributed transactions and employs a majority-based coordination system to maintain cluster state. The platform provides

Bolt is a single-file embedded key-value store for Go applications. It is an ACID transactional database that organizes data in B+trees on disk to provide efficient sorted key retrieval and range scans. The system uses a memory-mapped model to map the database file directly into the process address space for fast random-access reads. The project distinguishes itself through a multi-version concurrency control architecture that allows multiple simultaneous readers to access a consistent snapshot of data without blocking a writer. It employs a single-writer multi-reader locking model and uses a

better-sqlite3 is a high-performance SQLite3 client for Node.js that executes queries synchronously, returning results directly without callbacks or promises. It compiles as a native addon using N-API, binding directly to the SQLite3 C library for immediate query execution and zero-copy result serialization into native JavaScript objects. The library is optimized for Write-Ahead Logging (WAL) mode, enabling faster concurrent reads and writes in web applications. It provides durability level tuning through the synchronous pragma, allowing adjustments between FULL, NORMAL, and OFF modes to bala

Feast is an open-source feature store for machine learning that provides a central platform for defining, storing, and serving features across both training and inference workflows. It operates as a declarative system where feature definitions are written as code in Python files, synchronized to a central registry, and made available for low-latency online retrieval or point-in-time correct historical joins for training datasets. The project abstracts storage behind a pluggable architecture, allowing offline and online backends to be swapped without changing retrieval logic, and coordinates ma

NLog is an open-source logging framework for .NET that functions as a structured logging library and log routing engine. It captures log events with named parameters as searchable data rather than plain text and directs these messages to various output destinations based on severity and source. The framework is designed as an extensible platform, supporting custom targets, layout renderers, and filters that can be loaded from external assemblies or defined in code. It features a dynamic configuration system that allows logging targets, rules, and layouts to be updated via XML or programmatic

Maddy is a modular mail server that assembles a complete email system by connecting small, single-purpose modules through a declarative configuration file. Rather than a monolithic stack, it lets operators compose message processing, storage, authentication, and security enforcement from interchangeable building blocks, with each module handling a specific function like receiving SMTP connections, verifying credentials, or applying policy checks. The server distinguishes itself through its flexible authentication and security architecture. It delegates user verification to external systems in

This is an open-source, crowd-sourced wiki textbook that teaches Linux system programming in C. It covers the core operating system concepts of process management through the fork-exec-wait model, dynamic memory allocation using implicit free list heap allocators, inode-based file systems, inter-process communication via pipes and shared memory, POSIX threads with synchronization primitives, signal-based asynchronous notification, virtual memory with page table translation, and runtime diagnostics using Valgrind and GDB. The textbook distinguishes itself by providing practical, implementation

Pebble is an embedded key-value storage engine written in Go, designed as a library that provides durable, write-optimized data persistence directly within applications. It organizes data using a log-structured merge-tree (LSM-tree) structure, where writes are first buffered in an in-memory skiplist memtable and persisted to a write-ahead log before being flushed to block-based SSTable files on disk. The engine supports atomic batch commits, configurable write synchronization, and automatic background compaction that merges and rewrites sorted runs to reclaim space and maintain read performanc

Raspotify 是一个用于 Linux 设备的无头音频流媒体播放器，作为 Spotify Connect 客户端运行。它作为后台系统守护进程运行，使硬件能够充当可通过官方 Spotify 应用控制的无线音频接收器。 该服务专为单板计算机设计，并结合了磁盘写入最小化以减少 SD 卡磨损。它通过将音频轨道缓冲区重定向到内存文件系统来实现这一点。 该项目包括音频质量配置功能，包括比特率和采样率调整。它还通过本地令牌缓存管理身份验证，以在无需重复登录流程的情况下保持持久连接。

OpenTSDB 是一个分布式时间序列数据库和指标引擎，专为存储和管理海量高基数系统指标而设计。它作为一个数据存储和分析平台，支持跨分布式集群的大规模指标摄取和基础设施性能监控。 该系统以其支持 HBase、Cassandra 和 Google Bigtable 等多个后端的分布式存储抽象而著称。它利用分层指标树来组织时间序列，并采用数字标识符索引来减少存储占用并加速标记指标的查找。 该项目涵盖了广泛的能力领域，包括具有分布式百分位数计算和降采样功能的时间序列数据分析，以及全面的元数据管理。它提供用于数据摄取和查询的 API 集成、用于性能优化的堆外缓存，以及用于数据完整性审计和异常分析的工具。 该系统通过用于数据库管理和指标树同步的命令行界面进行管理。

ipscan 是一个跨平台网络审计工具和基于 Java 的网络扫描器，用于发现联网设备并导出扫描结果。它充当 IP 地址范围扫描器和 TCP/UDP 端口扫描器，以识别网络上的活动主机和开放服务。 该应用程序具有基于插件的获取器架构，允许集成自定义数据收集获取器，以从发现的主机中检索特定的硬件或软件信息。 其更广泛的功能包括本地网络发现、网络端口审计以及网络资产清单的创建。用户可以通过具有高密度屏幕缩放功能的图形用户界面或通过用于自动化扫描的命令行界面与软件进行交互。

该项目是一个专为初学者设计的综合 MySQL 数据库教程和教学资源。它作为一本技术手册和学习指南，涵盖了关系数据库管理系统的安装、配置和操作。 这些材料提供了一种结构化的关系数据库基础知识学习方法，包括模式设计、表创建和 SQL 查询执行。它包含关于数据库管理的具体指导，例如管理用户访问、配置存储引擎以及处理跨不同操作系统的服务器安装。 该资源涵盖了广泛的功能，包括针对临时数据和 Unicode 字符的数据操作、客户端-服务器连接以及数据库生命周期管理。它还提供用于系统故障排除的诊断信息，以解决安装冲突和启动错误。 内容以一系列基于 Markdown 的文档形式呈现，包含分步过程指南和示例驱动的查询演示。

This repository is a collection of technical knowledge and solutions focused on mobile application development, particularly for Android and iOS platforms. It covers a wide range of practical engineering challenges, including hotfix and patching techniques, database management and repair, network communication, logging, and video processing. The content is presented as shared knowledge, documenting real-world problems and their implementations. The project provides detailed guidance on applying hotfixes to running Android applications through multiple methods, such as class replacement, full

Toshi 是一个用 Rust 实现的全文本搜索引擎和库，旨在管理和查询大规模结构化数据集。它作为一个分布式搜索平台，能够在大规模数据集合中实现高速信息检索。 该系统通过专为高吞吐量摄取和并行查询执行而构建的架构脱颖而出。它利用 Actor 模型并发框架来协调工作进程，并采用分布式分片将索引段分区到多个节点上。为了保持性能和数据完整性，该引擎自动化了索引生命周期管理，包括后台段合并和持久化预写日志。 该平台提供了管理搜索基础设施的全面功能，包括用于扩展集群和调整摄取吞吐量的工具。它依赖倒排索引存储和内存映射文件访问来优化磁盘到内存的操作，确保随着数据量的增长保持一致的搜索性能。

XlsxWriter is a library for generating spreadsheets in the XLSX format, functioning as an Excel workbook writer and file generator. It provides the capability to write data, apply cell formatting, and build complex layouts across multiple worksheets. The project distinguishes itself with a memory-optimized writing mode that flushes large datasets to disk row-by-row, enabling the creation of files exceeding 4 GB while minimizing RAM consumption. It also includes a specialized mechanism for embedding binary project files and digital signatures to enable VBA macros and signed scripts within work