etcd-io/bbolt
Bbolt
bbolt is an ACID-compliant embedded key-value store for Go applications. It persists all data in a single memory-mapped file on disk, organizing information using B+ trees to facilitate sorted key iteration and efficient range queries.
The project distinguishes itself through a hierarchical data organization model, allowing buckets to be nested within other buckets to create a tree-like structure. It employs a single-writer, multi-reader locking mechanism and copy-on-write transactions to ensure serializable isolation and data integrity.
The system includes comprehensive data management capabilities, such as unique identifier generation, cursor-based iteration, and hot backup generation. Maintenance tools are provided for database compaction, consistency verification, and the repair of corrupted pages.
Command-line utilities are available for querying database content and inspecting internal structural metadata.
Features
- Key-Value Pair Managers - Implements a high-performance embedded key-value store for persisting application state in a single file.
- Key-Value Stores - Provides a persistent, embedded key-value store for Go applications using a single memory-mapped file.
- ACID Transactional Cores - Provides an ACID-compliant embedded database engine ensuring atomic, isolated, and consistent transactions.
- Memory-Mapped File Access - Utilizes memory-mapped file access to map the database file directly into the process address space for high-performance reads.
- Atomic Transactions - Ensures data consistency by executing multiple grouped read and write operations as a single atomic unit.
- Copy-on-Write Transactional Models - Uses copy-on-write transactional models to ensure atomicity and data integrity by writing modified pages to new locations.
- Nested Bucket Hierarchies - Provides nested bucket hierarchies that allow key-value sets to be organized in a tree-like structure.
- Persistent Application State - Persists application configuration and internal state to a single file that survives restarts and failures.
- Single-Writer Multi-Reader Locking - Employs a single-writer multi-reader locking mechanism to coordinate concurrent access to the database.
- B-Tree - Implements a B-tree page indexing structure to ensure efficient sorted key iteration and logarithmic search performance.
- Transaction Management - Manages transaction lifecycles to ensure serializable isolation with support for multiple concurrent readers and a single writer.
- Lexicographical Sorting - Stores keys in byte-sorted order to enable efficient range scans and sequential iteration via cursors.
- Storage Compaction Utilities - Includes a compaction process that reduces file size and fragmentation by copying keys into a new storage file.
- Unique Identifier Generators - Provides a utility for producing autoincrementing integer sequences to serve as unique keys within buckets.
- Database Backups - Implements a hot backup mechanism to create consistent database snapshots without blocking concurrent operations.
- Database Initializations - Manages the process of opening a database file with options for read-only access and memory pre-loading.
- Disk Synchronization - Implements a mechanism to force written data from memory to physical storage to ensure durability.
- Freelist Management - Tracks available storage space by maintaining a list of empty or reusable pages within the data file.
- Key-Value Store Iterators - Ships a cursor-based iteration system to traverse key-value pairs in lexicographical order.
- Single-File Persistence - Persists all buckets and key-value pairs within a single file on disk for easy portability.
- Advisory Locking Mechanisms - Provides an advisory locking mechanism to prevent multiple processes from concurrently corrupting the storage file.
- Bucket Management - Provides administrative controls for creating, deleting, and iterating over buckets to group related key-value pairs.
- Nested Data Buckets - Supports a hierarchical organization model allowing buckets to be nested within other buckets.
- Caching and Key-Value Stores - Embedded key-value store for local data persistence.
- Caching Libraries - Embedded key/value store.
- Database Engines - Embedded key/value database for Go.
- Database Systems - Listed in the “Database Systems” section of the Awesome Go awesome list.
- قواعد البيانات - Embedded key-value database.
- Databases & Data - Fork of the original embedded key/value store for reliable data.
