74 个仓库
Systems for persisting simple data types to device storage across application sessions.
Distinguishing note: Focuses on simple key-value storage rather than complex database management.
Explore 74 awesome GitHub repositories matching data & databases · Key-Value Persistence Stores. Refine with filters or upvote what's useful.
Fuel Core is a Rust-based implementation of a distributed ledger and a full node for the Fuel v2 protocol. It functions as a layer 2 blockchain client designed to execute binary encoded transactions and synchronize shared state across a decentralized network. The system utilizes a deterministic state machine to ensure all nodes reach the same ledger state and employs a binary-encoded message protocol for network communication. It provides the ability to operate full network nodes or bootstrap private local instances for development and testing. The project covers a broad set of capabilities
Maps the global blockchain ledger state to a persistent on-disk key-value database.
RocksDB is a high-performance, embeddable persistent key-value library and storage engine based on Log-Structured Merge-trees. It is designed to provide durable storage for large-scale datasets, integrating directly into applications to manage data on flash and RAM-based hardware. The engine is distinguished by its focus on minimizing read and write amplification through multi-threaded compaction and custom memory allocators. It features specialized optimizations for flash storage, including support for zoned block devices, and provides the ability to extend store behavior via external plugin
Provides a durable data store for large-scale datasets with atomic transactions and column families.
This project is a software engineering educational resource providing a collection of canonical system implementations. It serves as a library of computer science case studies and polyglot code examples designed to demonstrate architectural tradeoffs and design patterns through concise versions of fundamental software components. The repository focuses on studying the implementation of core concepts such as consensus algorithms, interpreters, and database engines. It provides minimal versions of complex systems to facilitate the analysis of language design, data structure implementation, and
Provides an append-only key-value store implementation demonstrating atomic superblock updates and leaf-to-root flushing.
localForage is a browser storage wrapper and key-value store that provides a unified JavaScript API for persisting data. It acts as an abstraction layer over IndexedDB, WebSQL, and localStorage, allowing web applications to save data offline. The library features a priority-based driver fallback system that automatically detects and selects the most capable storage engine available in the browser. It simplifies data management by providing an asynchronous interface for storing complex JavaScript objects and binary buffers without requiring manual serialization. The project covers broad capab
Provides a key-value persistence store in the browser with automatic fallback for compatibility.
NativeScript is a cross-platform mobile development framework that enables the creation of native iOS and Android applications using JavaScript or TypeScript. It provides a direct bridge to native platform APIs, allowing developers to invoke native classes, methods, and properties directly from script code while maintaining full access to underlying mobile operating system features. The framework distinguishes itself through its direct native UI rendering, which maps declarative markup components to actual platform-native widgets rather than web-based views. This architecture is supported by
Provides simple key-value storage mechanisms for persisting application data across sessions on mobile devices.
Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
Maintains mutable data across multiple crawler executions by storing it in a persistent key-value store.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Enables local-first database capabilities by persisting data directly to DenoKV.
This project is a browser extension that functions as a visual accessibility aid and dark mode generator. It dynamically analyzes web page content to create and apply dark color schemes, aiming to reduce eye strain and improve readability for users. The extension operates by injecting custom style sheets and filters directly into the browser document object model. It distinguishes itself through a combination of automated theme generation and granular control, allowing users to adjust brightness, contrast, and sepia levels. It also supports site-specific overrides and exclusions, enabling use
Maintains a persistent key-value store of domain-level visual preferences for consistent application across sessions.
Ava is a test runner for JavaScript and TypeScript designed to execute test suites with a focus on concurrency and isolation. It serves as a concurrent test executor that runs test files in parallel across multiple processes to reduce total runtime and prevent state leakage between suites. The project features a built-in snapshot testing framework that saves large data structures to disk and compares subsequent executions to detect regressions via diffs. It is also compatible with the Test Anything Protocol, allowing it to export results for use with external reporting tools. Its capability
Saves large data structures to disk and compares subsequent executions to detect regressions via diffs.
MMKV is a high-performance, cross-platform key-value storage framework designed for mobile platforms and POSIX environments, including Android, iOS, macOS, and Windows. It provides a persistence layer that utilizes memory-mapped files and binary serialization to achieve low-latency data access. The project distinguishes itself through native support for multi-process synchronization, allowing concurrent read and write operations across different application processes. It also implements security via AES encryption for data at rest, featuring symmetric encryption and key rotation to protect st
Provides a high-performance key-value persistence store for mobile devices using memory-mapped files.
Hubot is a Node.js bot engine and programmable framework for creating conversational agents that respond to user triggers and automate tasks across various messaging platforms. It functions as a command-based agent capable of processing deterministic slash commands with argument validation and role-based access control. The system uses a modular adapter pattern to connect a single bot instance to multiple chat backends through a unified interface. It is an extensible automation tool that allows the integration of external services, such as translation engines and mapping utilities, via custom
Uses external key-value stores to maintain bot memory and session data across restarts.
Valdi is a cross-platform native UI framework that compiles declarative TypeScript code into native platform views. It functions as a declarative UI engine and multi-platform frontend toolchain designed to achieve high performance by avoiding web views. The framework features a native bridge binding tool that generates type-safe bindings between TypeScript and native languages, allowing direct access to platform APIs. It supports a hot-reload development workflow, enabling real-time updates to the user interface across platforms without requiring full project recompilation. The system includ
Provides encrypted local key-value storage with time-to-live settings for data persistence.
Badger is an embeddable key-value store written in Go that provides persistent data storage for byte keys and values. It is a persistent database that utilizes a tiered LSM tree storage model to optimize disk storage and retrieval efficiency. The system features an ACID transaction engine that ensures data integrity through serializable snapshot isolation and multi-version concurrency control. It also provides an encrypted key-value store with data-at-rest encryption and a managed encrypted key registry to secure stored information. The engine covers a broad set of capabilities including hig
Provides a high-performance, embeddable Go library for persisting byte keys and values.
Newspaper is a Python library designed for scraping, parsing, and analyzing web-based information. It functions as a framework for automated news aggregation and large-scale web content extraction, providing tools to download, clean, and structure text, metadata, and media from diverse online sources. The project distinguishes itself through a pipeline-oriented architecture that combines heuristic-based content extraction with natural language processing. It automatically identifies and isolates article bodies from web page boilerplate while simultaneously performing language detection, keywo
Caches processed article metadata and content on disk to minimize redundant network requests.
Store.js is a client-side state persistence library and web storage abstraction layer. It provides a consistent browser key-value storage wrapper that manages the persistence of application state across sessions using the most capable available local storage mechanism. The engine is extensible, allowing for the integration of custom storage backends and plugins to modify how data is read and written. It functions as a reactive web storage manager, monitoring specific keys to trigger notifications when stored values are updated. The library handles automatic data serialization for complex typ
Persists simple key-value pairs across browser sessions using the most capable available storage mechanism.
This project is a cloud-based web IDE and development workspace that provides a professional code editor and execution environments directly within the browser. It functions as a browser-based code execution engine for rapid prototyping and a scalable cloud workspace for managing repositories and writing code without local environment configuration. The system features secure sandboxing for isolated development, allowing untrusted or experimental code to run in separated virtual environments. It supports both client-side execution via browser-based bundling and server-side execution through a
Saves the entire environment memory and disk state to allow instant restoration of development sessions.
Gunicorn is a production-grade WSGI HTTP server designed for deploying Python web applications. It functions as a process manager that utilizes a pre-fork worker model, where a master process initializes the application and spawns multiple child processes to handle incoming requests in parallel. This architecture ensures high performance and stability by isolating application execution within persistent worker processes. The server distinguishes itself through its flexible concurrency models and robust process lifecycle management. It supports interchangeable worker types, including synchrono
Maintains a global, in-memory key-value store accessible across all worker processes for shared data synchronization.
Doctrine ORM is a PHP object-relational mapper that connects application objects to relational database tables. It uses the data mapper and identity map patterns to decouple the in-memory object model from the database schema, allowing developers to manage data persistence without writing manual SQL. The project features a dedicated object-oriented query language and programmatic builder for retrieving data based on entities rather than tables. It implements a unit-of-work system to track object changes during a request and synchronize them via atomic transactions. The capability surface inc
Enables synchronization of session data with managed objects to persist state across requests.
This project provides a version of the Redis 3.0 codebase featuring detailed technical commentary and annotations. It serves as a technical resource for studying the internal design and implementation of an in-memory key-value store and the architecture of a networked NoSQL database. The documentation focuses on the implementation of the Redis Sentinel system, covering the mechanisms used for monitoring instance health, managing automatic failover, and notifying clients of primary node changes. The project covers broader architectural areas including in-memory data storage, high availability
Implements periodic serialization of the entire in-memory state to disk for recovery via child processes.
Better Discord enhances Discord desktop app with new features.
Provides per-plugin persistent key-value storage across sessions using local storage.