50 repository-uri
Relational or key-value storage engines that run within the application process without requiring a separate server.
Explore 50 awesome GitHub repositories matching data & databases · Embedded Databases. Refine with filters or upvote what's useful.
Bun is a high-performance runtime environment designed to execute JavaScript and TypeScript applications with minimal latency and high throughput. Built on a native core implemented in Zig, it provides a unified execution engine that leverages JavaScriptCore for efficient memory management and low-latency startup. The project functions as an all-in-one toolchain, integrating a native bundler, transpiler, package manager, and test runner into a single command-line interface. What distinguishes Bun is its focus on native system integration and developer productivity. It features a high-performa
Embeds relational storage engines directly within the application process to enable high-speed local data management without external servers.
Pocketbase is a backend-as-a-service platform that provides a self-contained, single-binary server for building full-stack applications. It integrates a relational database, authentication, and file storage into one executable process, eliminating the need for external infrastructure or complex server management. The platform distinguishes itself through an embedded database engine that runs directly within the application process and a reactive communication layer that pushes live updates to connected clients. By monitoring internal transaction logs, it synchronizes data across multiple user
Embeds a relational storage engine directly within the application process to remove the overhead of managing external database servers.
This project is a comprehensive dataset and archive of classical Chinese poetry, prose, and Confucian classics. It serves as a digital humanities corpus, providing machine-readable access to hundreds of thousands of poems and detailed poet biographies, specifically spanning the Tang and Song dynasties. The collection is distinguished by its scholarly depth, incorporating textual variation annotations to track disputed characters across different source editions. It also includes tonal pattern mapping to describe the rhythmic and phonetic structures of the verse, alongside a popularity ranking
Transforms structured literary data into relational SQLite database files for complex programmatic querying.
Legado is a digital library manager and content aggregator designed to collect, organize, and read text-based media from various online sources within a single mobile interface. It functions as a centralized platform for managing personal collections, supporting both e-book reading and the tracking of updates from multiple digital content providers. The application distinguishes itself through a modular architecture that allows users to import external source definitions, enabling the retrieval of content from diverse web-based providers. It utilizes sandboxed scripting and pattern-based extr
Uses local SQLite databases to store user libraries, reading progress, and source configurations for offline access.
LevelDB is an embedded database library and persistent storage engine that provides a sorted key-value store. It uses a log-structured merge-tree architecture to map byte arrays to values, running directly within a process to provide storage without the need for a separate server process. The system is distinguished by its use of custom comparison functions to define key ordering, enabling efficient range scans and sequenced lookups. It ensures data reliability through atomic batch execution, consistent snapshot generation, and log-based recovery after failures. The engine covers broad capab
Provides a high-performance storage engine that runs within the application process without a separate server.
DuckDB este o bază de date SQL analitică încorporată, în proces, și un sistem de gestionare a bazelor de date OLAP. Funcționează ca un motor de date pentru fișiere Parquet și CSV, permițând utilizatorilor să execute interogări SQL complexe pe seturi de date mari fără a necesita un proces de server separat. Sistemul este conceput pentru procesare analitică locală și fluxuri de lucru de știință a datelor încorporate. Acesta permite interogarea și analiza directă a fișierelor Parquet și CSV de pe disc, evitând necesitatea de a încărca datele într-o bază de date permanentă. Motorul oferă execuție SQL analitică de înaltă performanță, inclusiv suport pentru funcții de fereastră și subinterogări imbricate. Acesta încorporează un layout de stocare pe coloane și execuție vectorială a interogărilor pentru a gestiona manipularea și explorarea datelor la scară largă. Baza de date este accesibilă printr-o interfață de linie de comandă autonomă și binding-uri specifice limbajelor pentru Python, R, Java și Wasm.
Implements a relational storage engine that runs within the application process without a separate server.
Beekeeper Studio is a cross-platform desktop application designed for database management and SQL development. It provides a unified graphical interface to connect to, query, and modify data across a wide range of relational and NoSQL database systems. The application functions as a comprehensive workspace, integrating tools for schema design, record editing, and data visualization. The project distinguishes itself through a focus on secure, flexible connectivity and AI-assisted workflows. It supports advanced authentication methods, including enterprise single sign-on, multi-factor authentic
Generates new local SQLite database files for quick project setup.
iosched is an Android event scheduling application designed for browsing conference sessions, reserving seats, and managing personal event schedules. It serves as a cloud-synced event manager that keeps user preferences and reservations synchronized across devices. The project provides specialized tools for conference navigation, including integrated maps and informational pages to guide attendees through physical venue spaces. It also functions as a real-time notification client that delivers live updates regarding schedule changes and session availability. The application covers broad capa
Uses the Room persistence library to provide compile-time verified SQLite queries and reactive data streams for offline storage.
Turso is a distributed SQL database platform that provides managed, edge-hosted SQLite instances. It functions as a serverless database provider, enabling the deployment of relational databases that synchronize data across multiple geographic regions to support high availability and performance. The platform distinguishes itself by utilizing a fork of SQLite as its core storage engine, which supports both local file storage and remote network-based replication. It employs an edge-optimized proxy to route queries through a global network, minimizing latency by connecting users to the nearest d
Provides a distributed platform for hosting SQLite databases with global replication capabilities.
rqlite is a distributed relational database that replicates SQLite data across a cluster using the Raft consensus algorithm. It functions as a fault-tolerant storage system that provides high availability and a web API for executing SQL queries and managing relational data without requiring native database drivers. The system distinguishes itself by using an HTTP SQL interface to expose database operations and cluster management. It features a real-time change data capture stream that pushes database mutations to external HTTP endpoints via webhooks and supports the scaling of read throughput
Replicates SQLite data across a cluster using a consensus algorithm for fault-tolerant relational storage.
LibSQL is a high-performance, distributed SQL database engine that extends SQLite to support remote network access, edge computing, and real-time synchronization. It functions as an embedded database library that integrates directly into application processes while providing the infrastructure to maintain consistency across multiple geographic regions. The platform distinguishes itself by enabling database interaction over standard HTTP protocols, allowing applications to query remote data sources in serverless and edge environments without requiring local filesystem access. It includes nativ
Extends SQLite to provide a high-performance, distributed SQL database engine.
dirsearch is a command-line security tool and web path scanner used for discovering hidden directories and files on web servers. It functions as a recursive directory fuzzer and brute-force utility that identifies undocumented paths and sensitive files using wordlists and HTTP status codes. The tool distinguishes itself through template-driven path generation and an automated HTTP response filter that uses status codes, content length, and regex patterns to isolate valid targets. It supports recursive directory crawling to map complex web structures and provides state-persistence serializatio
Writes discovered paths and server responses into SQL tables for structured data storage and querying.
Gophish is an open-source phishing toolkit and simulation framework designed to test organizational security awareness and evaluate vulnerability to social engineering attacks. It provides a core engine for sending deceptive emails to targets and tracking their interactions to identify gaps in security training. The platform functions as a comprehensive campaign manager for deploying lures and monitoring email delivery and click-through rates. It allows for the design and execution of simulated email threats to track how targets interact with malicious-looking content or provide credentials i
Uses a local file-based SQLite database to store campaign configurations and tracking data with zero dependencies.
fmdb is an object-oriented SQLite database library and persistence layer for native macOS and iOS environments. It provides an Objective-C wrapper that encapsulates the low-level C API, allowing applications to manage local relational data storage and embedded database connections through a high-level interface. The library focuses on thread-safe database access by synchronizing operations across multiple threads using serialized queues to prevent data corruption and race conditions. It includes specialized capabilities for secure local storage, such as database encryption and the management
Provides a complete embedded database management system for native applications without requiring a separate server.
sql.js is a serverless, in-memory SQL database engine that ports SQLite to WebAssembly for use within a web browser. It provides a JavaScript interface to initialize relational databases, execute SQL queries, and manage structured data without requiring a backend server. The project enables the import and export of database states using typed arrays, allowing in-memory data to be persisted as files. It supports high-precision integer retrieval via BigInt and utilizes prepared statements to increase execution speed and security. The engine includes capabilities for client-side data management
Allows exporting the current in-memory database state as a binary typed array for local persistence.
Litestream is a database backup utility that provides continuous, incremental replication for SQLite databases. It operates as a background process that monitors local database files and streams modifications to remote cloud storage, ensuring that off-site backups are maintained without manual intervention. The tool functions by intercepting the database file system layer to capture page-level changes and tailing the write-ahead log. This approach allows for real-time synchronization of transactions to various cloud object storage providers through a unified abstraction layer. Beyond continu
Continuously streams local database changes to remote cloud storage for real-time backup.
Matrix is a suite of mobile application performance management and analysis tools. It provides a plugin-based monitoring system for capturing crashes, lags, and memory leaks, alongside a static binary auditor for reducing installation package size and a bytecode instrumentation tool for performance tracking. The project distinguishes itself through native memory debugging and a SQLite query linter that identifies inefficient database patterns. It employs native interception techniques to detect memory leaks and heap corruption without requiring source code recompilation, and uses a custom run
Scans database operations for inefficiencies such as full table scans and missing indices.
Stash is a self-hosted platform designed for organizing, cataloging, and managing personal video collections. It functions as a local server that indexes media files from your file system and stores their relationships, tags, and metadata within a relational database. The platform distinguishes itself through a modular, plugin-driven scraper engine that automatically retrieves and normalizes metadata from community-maintained online sources. This system eliminates manual data entry by populating your library with detailed information about performers, studios, and content tags. Beyond basic
Uses an embedded SQLite database to store and query complex media relationships.
WatermelonDB is an offline-first data synchronization engine and reactive database library designed for mobile and web applications. It provides a persistent storage layer backed by SQLite, enabling applications to maintain full functionality and data consistency while operating without an internet connection. The framework distinguishes itself through a reactive data binding system that automatically updates user interface components whenever underlying database records change. It utilizes schema-driven model mapping to generate type-safe interfaces and employs lazy object materialization to
Provides a high-performance reactive database layer that synchronizes local SQLite data with remote backends.
WCDB is a cross-platform storage layer and embedded database engine that serves as a framework for SQLite. It functions as an object relational mapper, linking application classes to database tables to enable data operations via objects rather than raw queries. The project is distinguished by an integrated encryption layer for securing data at rest and a full-text search engine that uses language-specific tokenizers for text lookups. It also features transparent field compression to reduce storage footprints and a connection-pooling model to coordinate simultaneous read and write operations a
Utilizes a relational SQLite engine to handle low-level disk I/O and atomic transactions for persistence.