25 Repos
Mechanisms for saving system states and indexed data to local disk storage.
Distinguishing note: Focuses on persistence for AI indexes rather than general database storage.
Explore 25 awesome GitHub repositories matching data & databases · Local Data Persistence. Refine with filters or upvote what's useful.
NewPipe is a privacy-focused media client that aggregates content from multiple streaming platforms into a single, unified interface. By utilizing a specialized parsing engine, the application extracts structured metadata directly from raw web content, allowing users to browse and play media without requiring individual service accounts or proprietary tracking. The application distinguishes itself through a decoupled playback engine that separates core streaming logic from the user interface, enabling persistent background audio and floating window playback. To ensure consistent access, the s
Stores all user history, subscriptions, and preferences in a local database to ensure complete privacy and offline availability.
Kotaemon is an orchestration framework designed for building modular, agentic workflows that integrate document processing, retrieval-augmented generation, and multi-step reasoning. It provides a comprehensive platform for developing document-based question answering systems, allowing users to chain language models, prompt templates, and external tools into complex, automated pipelines. The system distinguishes itself through a highly modular architecture that emphasizes component-based composition and schema-driven data exchange. It supports autonomous agents capable of decomposing complex q
Persists document collections and indexes to local storage to ensure data availability across system restarts.
This project is a command-line utility and development framework designed to modify, extend, and customize the Spotify desktop client. It functions as a binary patching engine that injects custom scripts, stylesheets, and interface components directly into the host application, enabling users to alter visual themes and add new functionality. The tool distinguishes itself by providing a comprehensive development environment for building modular extensions and custom applications. It includes a hot-reloading pipeline for rapid iteration, a declarative library for constructing interactive UI pan
Stores and retrieves key-value pairs in local storage, namespaced by user account to maintain isolated settings.
This project is a comprehensive framework for building and managing autonomous agent systems. It provides a unified architecture for orchestrating multi-agent societies, where specialized agents collaborate through roleplay to decompose and solve complex tasks. The system integrates language models with external environments, enabling agents to perform real-world actions through a standardized tool-calling abstraction layer. The framework distinguishes itself through its focus on iterative reasoning and data reliability. It employs automated feedback loops to refine agent outputs and self-eva
Manages Discord application installation records in local databases to maintain state.
Ragas is an evaluation framework designed to measure the performance of retrieval-augmented generation pipelines and autonomous agent workflows. It provides a comprehensive suite of tools for benchmarking system outputs, utilizing language models as automated judges to score performance against defined rubrics and reference data. By standardizing inputs, retrieved contexts, and generated responses into a unified schema, the project enables consistent analysis across complex AI applications. The framework distinguishes itself through its ability to generate synthetic test datasets from existin
Saves cached information to the local file system to ensure processed results remain available across sessions.
SQLite.swift is a type-safe Swift wrapper and object-relational mapping layer that provides a bridge for interacting with SQLite databases. It functions as a database driver that allows for embedded database management and local data persistence within Swift applications. The project distinguishes itself through a type-safe expression builder that verifies SQL statement syntax and intent at compile time. It includes specialized support for high-performance text matching via full-text search integration and provides mechanisms for securing sensitive data through database encryption. The libra
Enables saving application state and indexed data to local disk for persistence across restarts.
Rerun is a multimodal data visualizer and robotics data logger designed for rendering synchronized streams of 3D spatial data, images, and time-series metrics. It functions as a tool for capturing high-frequency sensor data and AI outputs into a queryable columnar format, providing a dedicated interface for viewing MCAP recording files and analyzing physical environments. The project distinguishes itself as a machine learning dataset streamer, capable of feeding logged recordings directly into GPU buffers and PyTorch training pipelines without intermediate exports. It supports a high-performa
Saves high-frequency sensor logs and AI outputs to binary files for offline playback and sharing.
This project is an AI-powered IDE extension and LLM coding assistant that provides a conversational interface for generating, refactoring, and debugging code. It functions as an AI agent framework and a Model Context Protocol client, connecting AI models to external data sources and tools to automate complex development tasks. The system is distinguished by its use of autonomous AI agents capable of multi-step task execution, including the ability to read files, modify code, and run terminal commands iteratively. It supports recursive agent orchestration through subagent delegation and employ
Persists telemetry spans to a local SQLite database for offline inspection and analysis.
This repository contains the HTML specification, which defines the core standards for web page structuring, content organization, and document rendering. It establishes the fundamental algorithms for state-machine-based tokenization, tree construction for the document object model, and origin-based security isolation. The specification provides a framework for defining custom elements with independent lifecycles and registries. It also details the requirements for cross-document communication, session history management, and the synchronization of interface properties with content attributes.
Ensures data remains available across sessions for a specific origin after a browser restart.
Vesktop is an Electron-based desktop client for Discord that runs natively on Linux, offering improved performance and deeper system integration compared to the official web app. It wraps Discord in an Electron shell to provide a lightweight, native desktop experience while adding a privacy protection layer that blocks Discord's access to system-level information such as running processes and hardware details. The client distinguishes itself through comprehensive Linux desktop support, including full Wayland display protocol integration for better performance on modern Linux desktops, screen
Provides a native Electron-based Discord client that runs on Linux without the performance overhead of the official web app.
Noms is a distributed version control database and content-addressable data store. It identifies data by cryptographic hashes to ensure integrity and deduplication, while tracking dataset state changes through a sequence of immutable commits to enable branching, forking, and historical recovery. The system functions as a peer-to-peer data synchronizer, reconciling state between disconnected database instances to ensure all nodes converge on the same data. It distinguishes itself as a schema-flexible document store that supports self-describing types, allowing schemas to evolve and widen as ne
Saves database content to local file systems for durable storage.
Android-Expert is a collection of educational resources and step-by-step instructional materials for learning Android app programming. It provides a comprehensive learning path for building mobile applications using the Kotlin programming language and Android Studio. The material covers the full development lifecycle, from designing interactive user interfaces with lists, cards, and sliders to implementing navigation workflows and screen transitions. It also includes instruction on connecting applications to remote servers to fetch external data and integrating that data into the app flow. T
Provides mechanisms for saving user settings and application state to local disk storage.
This project is a Rust-based AI agent framework and tool orchestrator that provides a command-line interface for interacting with large language models. It functions as an AI tool orchestrator that routes client requests to language servers and manages the planning and handoffs between specialized agents to solve complex tasks. The system distinguishes itself as a language porting validator, using deterministic mocks and specifications to verify feature parity between different language implementations of a codebase. It further extends agent capabilities by acting as a Model Context Protocol
Saves conversation states to local storage and restores them to allow users to continue previous interactions.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Saves in-memory data to local storage periodically to enable full cluster recovery after a planned or unplanned shutdown.
This is a demonstration and template project that applies Clean Architecture principles to SwiftUI application development. It implements a layered architecture that separates presentation, business logic, and data access into independent layers, with unidirectional data flow managed through a single immutable app store that serves as the sole source of truth for all screens. The project distinguishes itself through its implementation of interactor-driven business logic, where all domain rules and workflows live in stateless objects that receive requests and update the central store. Dependen
Stores and retrieves structured data on the device using SwiftData local persistence.
Altair ist ein grafischer GraphQL-API-Client, eine integrierte Entwicklungsumgebung (IDE) und ein Schema-Explorer. Es fungiert als Debugging-Tool und Kollaborationsplattform für die Ausführung von Queries, Mutations und Subscriptions gegen GraphQL-Server. Das Projekt zeichnet sich durch cloud-synchronisierte Workspaces aus, um Query-Sammlungen innerhalb von Teams zu organisieren und zu teilen. Es bietet ein flexibles Erweiterungs-Framework, das die Installation und Ausführung von Drittanbieter-Plugins in isolierten Sandboxes ermöglicht. Die Plattform deckt eine Vielzahl von Funktionen ab, darunter KI-gestützte Query-Erstellung, visuelle Schema-Erkundung und Echtzeit-Daten-Subscriptions über mehrere Transportprotokolle. Zudem enthält sie Tools für Request-Automatisierung durch Pre- und Post-Request-Scripting sowie Dienstprogramme zur Verwaltung von Umgebungsvariablen und zur Analyse von Response-Metadaten. Altair ist als Desktop-Anwendung, Browser-Erweiterung und webbasierte Anwendung verfügbar und kann auf privaten Servern gehostet werden.
Uses local storage to persist values and maintain state across multiple API requests.
SparkInternals ist ein technisches Referenz- und Architekturhandbuch, das das interne Design und die Implementierung der verteilten Computing-Engine Apache Spark detailliert beschreibt. Es dient als Analyse von Big-Data-Engines und konzentriert sich darauf, wie das System die Cluster-Ausführung sowie das Zusammenspiel zwischen Driver-Nodes, Executors und Workern verwaltet. Das Projekt bietet eine detaillierte Aufschlüsselung, wie logische Pläne in physische Ausführungsstufen konvertiert werden. Es analysiert spezifisch die Mechanik von Data-Shuffle-Operationen, Speicherverwaltung und die Koordination der verteilten Job-Planung. Die Dokumentation deckt ein breites Spektrum an verteilten Computing-Funktionen ab, einschließlich Query-Execution-Planung, Datenabhängigkeitsmanagement und In-Memory-Caching-Strategien. Zudem werden Aufgabenverteilung, parallele Ausführung sowie Prozesse zur Fehlerwiederherstellung und Datenpersistenz untersucht.
Writes partitioned output records to local disk files to ensure fault tolerance and reduce memory pressure.
Racket ist eine Mehrzweck-Programmiersprache mit mehreren Paradigmen aus der Lisp-Familie, die für die Sprachschöpfung entwickelt wurde. Sie fungiert als Sprach-Workbench und bietet eine Plattform zum Entwerfen und Implementieren benutzerdefinierter Programmiersprachen durch ein flexibles System aus Makros und Modulen. Das System zeichnet sich durch eine umfassende Suite für Semantik-Engineering aus, die den Aufbau spezialisierter Sprach-Subsets und Bildungsschichten ermöglicht. Es enthält Tools für das Design benutzerdefinierter Sprachen, wie Lexer- und Parser-Generierung, sowie die Fähigkeit, Modul-Erweiterungsregeln und dynamische Sprachauswahl zur Lesezeit zu definieren. Das Projekt bietet eine integrierte Entwicklungsumgebung mit eingebautem Editor, visuellem Debugger und einem Software-Paketmanager. Die Funktionspalette erstreckt sich auf eine Standardbibliothek für allgemeine Zwecke, die 2D-Grafik-Rendering, Binärdatenverarbeitung, SQL- und deduktive Datenbankintegration sowie den Bau grafischer Benutzeroberflächen abdeckt. Die Umgebung unterstützt das Kompilieren von Quellcode in eigenständige ausführbare Dateien für die Distribution.
Saves and restores application state to the local file system using serializable structures.
zvec is an embedded vector database engine and indexing library designed for high-dimensional similarity search. It functions as a hybrid search engine and a retrieval-augmented generation knowledge base, allowing for the storage and retrieval of dense and sparse vectors. The system is distinguished by its hybrid retrieval pipeline, which fuses vector similarity, full-text keyword matching, and scalar metadata filtering into single query operations. It supports a plugin-based model integration system for registering custom embedding models and rerankers, as well as language bindings for nativ
Saves collections into dedicated, self-contained directories to ensure isolation and local persistence.
lollms-webui ist eine webbasierte Benutzeroberfläche und ein lokaler KI-Modell-Orchestrator, der für die Interaktion mit und die Verwaltung von Large Language Models und multimodaler KI auf lokaler Hardware konzipiert ist. Es fungiert als generative KI-Multimedia-Suite, die die Erstellung von Text, Bildern, Video und Musik durch integrierte Diffusions- und Sprachmodelle ermöglicht. Das Projekt bietet einen dedizierten Persona-Manager zur Konfiguration von Verhaltensprofilen und distinkten Persönlichkeiten, die Stil und Tonfall der Modellantworten steuern. Es enthält ein lokales Speichersystem zur Aufrechterhaltung des langfristigen Konversationskontexts und der Chat-Historie über einen persistenten Speichermechanismus. Das System deckt breite Funktionen ab, einschließlich dynamischem Prompt-Routing zur Inferenz-Optimierung, GPU-Beschleunigung und einem modularen Binding-System zur Verknüpfung mit lokalen oder entfernten Modellanbietern. Es bietet zudem Tools zur Visualisierung von KI-Denkprozessen, zur Verwaltung von Chat-Historien in einer lokalen Datenbank und zur Erweiterung der Schnittstelle über ein Plugin-basiertes Tool-System. Das Deployment wird durch containerisierte Images unterstützt, um eine konsistente Ausführung über verschiedene Betriebssysteme hinweg sicherzustellen.
Maps host directories to containers to ensure model files and configurations persist across restarts.