25 repository-uri
Mechanisms for saving system states and indexed data to local disk storage.
Distinguishing note: Focuses on persistence for AI indexes rather than general database storage.
Explore 25 awesome GitHub repositories matching data & databases · Local Data Persistence. Refine with filters or upvote what's useful.
NewPipe is a privacy-focused media client that aggregates content from multiple streaming platforms into a single, unified interface. By utilizing a specialized parsing engine, the application extracts structured metadata directly from raw web content, allowing users to browse and play media without requiring individual service accounts or proprietary tracking. The application distinguishes itself through a decoupled playback engine that separates core streaming logic from the user interface, enabling persistent background audio and floating window playback. To ensure consistent access, the s
Stores all user history, subscriptions, and preferences in a local database to ensure complete privacy and offline availability.
Kotaemon is an orchestration framework designed for building modular, agentic workflows that integrate document processing, retrieval-augmented generation, and multi-step reasoning. It provides a comprehensive platform for developing document-based question answering systems, allowing users to chain language models, prompt templates, and external tools into complex, automated pipelines. The system distinguishes itself through a highly modular architecture that emphasizes component-based composition and schema-driven data exchange. It supports autonomous agents capable of decomposing complex q
Persists document collections and indexes to local storage to ensure data availability across system restarts.
This project is a command-line utility and development framework designed to modify, extend, and customize the Spotify desktop client. It functions as a binary patching engine that injects custom scripts, stylesheets, and interface components directly into the host application, enabling users to alter visual themes and add new functionality. The tool distinguishes itself by providing a comprehensive development environment for building modular extensions and custom applications. It includes a hot-reloading pipeline for rapid iteration, a declarative library for constructing interactive UI pan
Stores and retrieves key-value pairs in local storage, namespaced by user account to maintain isolated settings.
This project is a comprehensive framework for building and managing autonomous agent systems. It provides a unified architecture for orchestrating multi-agent societies, where specialized agents collaborate through roleplay to decompose and solve complex tasks. The system integrates language models with external environments, enabling agents to perform real-world actions through a standardized tool-calling abstraction layer. The framework distinguishes itself through its focus on iterative reasoning and data reliability. It employs automated feedback loops to refine agent outputs and self-eva
Manages Discord application installation records in local databases to maintain state.
Ragas is an evaluation framework designed to measure the performance of retrieval-augmented generation pipelines and autonomous agent workflows. It provides a comprehensive suite of tools for benchmarking system outputs, utilizing language models as automated judges to score performance against defined rubrics and reference data. By standardizing inputs, retrieved contexts, and generated responses into a unified schema, the project enables consistent analysis across complex AI applications. The framework distinguishes itself through its ability to generate synthetic test datasets from existin
Saves cached information to the local file system to ensure processed results remain available across sessions.
SQLite.swift is a type-safe Swift wrapper and object-relational mapping layer that provides a bridge for interacting with SQLite databases. It functions as a database driver that allows for embedded database management and local data persistence within Swift applications. The project distinguishes itself through a type-safe expression builder that verifies SQL statement syntax and intent at compile time. It includes specialized support for high-performance text matching via full-text search integration and provides mechanisms for securing sensitive data through database encryption. The libra
Enables saving application state and indexed data to local disk for persistence across restarts.
Rerun is a multimodal data visualizer and robotics data logger designed for rendering synchronized streams of 3D spatial data, images, and time-series metrics. It functions as a tool for capturing high-frequency sensor data and AI outputs into a queryable columnar format, providing a dedicated interface for viewing MCAP recording files and analyzing physical environments. The project distinguishes itself as a machine learning dataset streamer, capable of feeding logged recordings directly into GPU buffers and PyTorch training pipelines without intermediate exports. It supports a high-performa
Saves high-frequency sensor logs and AI outputs to binary files for offline playback and sharing.
This project is an AI-powered IDE extension and LLM coding assistant that provides a conversational interface for generating, refactoring, and debugging code. It functions as an AI agent framework and a Model Context Protocol client, connecting AI models to external data sources and tools to automate complex development tasks. The system is distinguished by its use of autonomous AI agents capable of multi-step task execution, including the ability to read files, modify code, and run terminal commands iteratively. It supports recursive agent orchestration through subagent delegation and employ
Persists telemetry spans to a local SQLite database for offline inspection and analysis.
This repository contains the HTML specification, which defines the core standards for web page structuring, content organization, and document rendering. It establishes the fundamental algorithms for state-machine-based tokenization, tree construction for the document object model, and origin-based security isolation. The specification provides a framework for defining custom elements with independent lifecycles and registries. It also details the requirements for cross-document communication, session history management, and the synchronization of interface properties with content attributes.
Ensures data remains available across sessions for a specific origin after a browser restart.
Vesktop is an Electron-based desktop client for Discord that runs natively on Linux, offering improved performance and deeper system integration compared to the official web app. It wraps Discord in an Electron shell to provide a lightweight, native desktop experience while adding a privacy protection layer that blocks Discord's access to system-level information such as running processes and hardware details. The client distinguishes itself through comprehensive Linux desktop support, including full Wayland display protocol integration for better performance on modern Linux desktops, screen
Provides a native Electron-based Discord client that runs on Linux without the performance overhead of the official web app.
Noms is a distributed version control database and content-addressable data store. It identifies data by cryptographic hashes to ensure integrity and deduplication, while tracking dataset state changes through a sequence of immutable commits to enable branching, forking, and historical recovery. The system functions as a peer-to-peer data synchronizer, reconciling state between disconnected database instances to ensure all nodes converge on the same data. It distinguishes itself as a schema-flexible document store that supports self-describing types, allowing schemas to evolve and widen as ne
Saves database content to local file systems for durable storage.
Android-Expert is a collection of educational resources and step-by-step instructional materials for learning Android app programming. It provides a comprehensive learning path for building mobile applications using the Kotlin programming language and Android Studio. The material covers the full development lifecycle, from designing interactive user interfaces with lists, cards, and sliders to implementing navigation workflows and screen transitions. It also includes instruction on connecting applications to remote servers to fetch external data and integrating that data into the app flow. T
Provides mechanisms for saving user settings and application state to local disk storage.
This project is a Rust-based AI agent framework and tool orchestrator that provides a command-line interface for interacting with large language models. It functions as an AI tool orchestrator that routes client requests to language servers and manages the planning and handoffs between specialized agents to solve complex tasks. The system distinguishes itself as a language porting validator, using deterministic mocks and specifications to verify feature parity between different language implementations of a codebase. It further extends agent capabilities by acting as a Model Context Protocol
Saves conversation states to local storage and restores them to allow users to continue previous interactions.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Saves in-memory data to local storage periodically to enable full cluster recovery after a planned or unplanned shutdown.
This is a demonstration and template project that applies Clean Architecture principles to SwiftUI application development. It implements a layered architecture that separates presentation, business logic, and data access into independent layers, with unidirectional data flow managed through a single immutable app store that serves as the sole source of truth for all screens. The project distinguishes itself through its implementation of interactor-driven business logic, where all domain rules and workflows live in stateless objects that receive requests and update the central store. Dependen
Stores and retrieves structured data on the device using SwiftData local persistence.
Altair is a graphical GraphQL API client, integrated development environment, and schema explorer. It functions as a debugging tool and collaboration platform for executing queries, mutations, and subscriptions against GraphQL servers. The project distinguishes itself by offering cloud-synced workspaces for organizing and sharing query collections among teams. It provides a flexible extensibility framework that allows the installation and execution of third-party plugins within isolated sandboxes. The platform covers a broad range of capabilities, including AI-assisted query writing, visual
Uses local storage to persist values and maintain state across multiple API requests.
SparkInternals este un ghid tehnic de referință și arhitectură care detaliază designul intern și implementarea motorului de calcul distribuit Apache Spark. Acesta servește drept studiu de analiză a motoarelor de big data, concentrându-se pe modul în care sistemul gestionează execuția în cluster și interacțiunea dintre nodurile driver, executori și workeri. Proiectul oferă o detaliere a modului în care planurile logice sunt convertite în etape de execuție fizică. Analizează în mod specific mecanica operațiunilor de shuffle a datelor, gestionarea memoriei și coordonarea programării joburilor distribuite. Documentația acoperă o gamă largă de capabilități de calcul distribuit, inclusiv planificarea execuției interogărilor, gestionarea dependențelor de date și strategii de caching în memorie. De asemenea, examinează distribuția sarcinilor, execuția paralelă și procesele utilizate pentru recuperarea în caz de eroare și persistența datelor.
Writes partitioned output records to local disk files to ensure fault tolerance and reduce memory pressure.
Racket este un limbaj de programare general-purpose, multi-paradigmă, din familia Lisp, conceput pentru crearea de limbaje. Funcționează ca un banc de lucru pentru limbaje (language workbench), oferind o platformă pentru proiectarea și implementarea de limbaje de programare personalizate printr-un sistem flexibil de macro-uri și module. Sistemul se distinge prin oferirea unei suite cuprinzătoare pentru ingineria semantică, permițând construcția de subseturi de limbaje specializate și straturi educaționale. Include instrumente pentru designul de limbaje personalizate, cum ar fi generarea de lexere și parsere, precum și capacitatea de a defini reguli de expansiune a modulelor și selecția dinamică a limbajului la momentul citirii (read-time). Proiectul oferă un mediu de dezvoltare integrat (IDE) cu editor încorporat, debugger vizual și un manager de pachete software. Suprafața sa de capabilități se extinde la o bibliotecă standard general-purpose care acoperă randarea graficii 2D, procesarea datelor binare, integrarea SQL și a bazelor de date deductive, precum și construcția de interfețe grafice. Mediul suportă compilarea codului sursă în fișiere executabile standalone pentru distribuție.
Saves and restores application state to the local file system using serializable structures.
zvec is an embedded vector database engine and indexing library designed for high-dimensional similarity search. It functions as a hybrid search engine and a retrieval-augmented generation knowledge base, allowing for the storage and retrieval of dense and sparse vectors. The system is distinguished by its hybrid retrieval pipeline, which fuses vector similarity, full-text keyword matching, and scalar metadata filtering into single query operations. It supports a plugin-based model integration system for registering custom embedding models and rerankers, as well as language bindings for nativ
Saves collections into dedicated, self-contained directories to ensure isolation and local persistence.
lollms-webui este o interfață utilizator bazată pe web și un orchestrator local de modele AI conceput pentru interacțiunea și gestionarea modelelor de limbaj mari și AI multimodal pe hardware local. Acesta funcționează ca o suită multimedia AI generativă care permite crearea de text, imagini, video și muzică prin modele integrate de difuzie și limbaj. Proiectul dispune de un manager de persona dedicat pentru a configura profiluri comportamentale și personalități distincte, controlând stilul și tonul răspunsurilor modelului. Include un sistem de memorie locală pentru menținerea contextului conversației pe termen lung și a istoricului chat-ului printr-un mecanism de stocare persistentă. Sistemul acoperă capabilități largi, inclusiv rutarea dinamică a prompt-urilor pentru optimizarea inferenței, accelerarea GPU și un sistem de binding modular pentru conectarea la furnizori de modele locali sau la distanță. De asemenea, oferă instrumente pentru vizualizarea proceselor de raționament AI, gestionarea istoricelor de chat într-o bază de date locală și extinderea interfeței printr-un sistem de instrumente bazat pe plugin-uri. Deployment-ul este susținut prin imagini containerizate pentru a asigura o execuție consistentă pe diferite sisteme de operare.
Maps host directories to containers to ensure model files and configurations persist across restarts.