Awesome GitHub RepositoriesSorted Memory Buffers

LevelDB is an embedded database library and persistent storage engine that provides a sorted key-value store. It uses a log-structured merge-tree architecture to map byte arrays to values, running directly within a process to provide storage without the need for a separate server process. The system is distinguished by its use of custom comparison functions to define key ordering, enabling efficient range scans and sequenced lookups. It ensures data reliability through atomic batch execution, consistent snapshot generation, and log-based recovery after failures. The engine covers broad capab

RocksDB is a high-performance, embeddable persistent key-value library and storage engine based on Log-Structured Merge-trees. It is designed to provide durable storage for large-scale datasets, integrating directly into applications to manage data on flash and RAM-based hardware. The engine is distinguished by its focus on minimizing read and write amplification through multi-threaded compaction and custom memory allocators. It features specialized optimizations for flash storage, including support for zoned block devices, and provides the ability to extend store behavior via external plugin

goleveldb 是一个 Go 语言的嵌入式键值存储数据库。它提供本地数据持久化和索引，允许应用使用唯一键存储和检索信息，而无需单独的服务器。 该数据库使用日志结构合并树（LSM-tree）和按字典顺序排列的持久化索引来组织数据。这种结构支持高效的范围扫描和基于前缀的搜索。 该系统包含用于原子批量写入的功能，以确保数据一致性并避免部分更新。性能通过预写日志（WAL）、基于内存的缓冲和布隆过滤器进行管理，以减少不必要的磁盘输入和输出。

Mini-LSM 是一个教育性存储引擎和键值数据库库，旨在演示日志结构合并树（LSM-tree）架构的实现。它作为教学资源，用于理解如何从零开始构建高性能存储系统，重点关注持久化数据结构和基于磁盘的存储机制。 该项目提供了一个功能框架，用于通过内存到磁盘的刷新和多版本并发控制（MVCC）来管理数据。它通过实现基于快照的隔离来脱颖而出，允许在并发操作期间查看数据库状态的一致视图，并利用分层压缩策略来组织数据文件并优化读取性能。 该引擎涵盖了广泛的存储管理能力，包括用于崩溃恢复的预写日志（WAL）和用于最小化磁盘 I/O 的概率索引。它还包含一套验证工具和测试工具，旨在验证存储操作的完整性并协助诊断并发相关问题。