25 repositorios
Mechanisms for saving system states and indexed data to local disk storage.
Distinguishing note: Focuses on persistence for AI indexes rather than general database storage.
Explore 25 awesome GitHub repositories matching data & databases · Local Data Persistence. Refine with filters or upvote what's useful.
NewPipe is a privacy-focused media client that aggregates content from multiple streaming platforms into a single, unified interface. By utilizing a specialized parsing engine, the application extracts structured metadata directly from raw web content, allowing users to browse and play media without requiring individual service accounts or proprietary tracking. The application distinguishes itself through a decoupled playback engine that separates core streaming logic from the user interface, enabling persistent background audio and floating window playback. To ensure consistent access, the s
Stores all user history, subscriptions, and preferences in a local database to ensure complete privacy and offline availability.
Kotaemon is an orchestration framework designed for building modular, agentic workflows that integrate document processing, retrieval-augmented generation, and multi-step reasoning. It provides a comprehensive platform for developing document-based question answering systems, allowing users to chain language models, prompt templates, and external tools into complex, automated pipelines. The system distinguishes itself through a highly modular architecture that emphasizes component-based composition and schema-driven data exchange. It supports autonomous agents capable of decomposing complex q
Persists document collections and indexes to local storage to ensure data availability across system restarts.
This project is a command-line utility and development framework designed to modify, extend, and customize the Spotify desktop client. It functions as a binary patching engine that injects custom scripts, stylesheets, and interface components directly into the host application, enabling users to alter visual themes and add new functionality. The tool distinguishes itself by providing a comprehensive development environment for building modular extensions and custom applications. It includes a hot-reloading pipeline for rapid iteration, a declarative library for constructing interactive UI pan
Stores and retrieves key-value pairs in local storage, namespaced by user account to maintain isolated settings.
This project is a comprehensive framework for building and managing autonomous agent systems. It provides a unified architecture for orchestrating multi-agent societies, where specialized agents collaborate through roleplay to decompose and solve complex tasks. The system integrates language models with external environments, enabling agents to perform real-world actions through a standardized tool-calling abstraction layer. The framework distinguishes itself through its focus on iterative reasoning and data reliability. It employs automated feedback loops to refine agent outputs and self-eva
Manages Discord application installation records in local databases to maintain state.
Ragas is an evaluation framework designed to measure the performance of retrieval-augmented generation pipelines and autonomous agent workflows. It provides a comprehensive suite of tools for benchmarking system outputs, utilizing language models as automated judges to score performance against defined rubrics and reference data. By standardizing inputs, retrieved contexts, and generated responses into a unified schema, the project enables consistent analysis across complex AI applications. The framework distinguishes itself through its ability to generate synthetic test datasets from existin
Saves cached information to the local file system to ensure processed results remain available across sessions.
SQLite.swift is a type-safe Swift wrapper and object-relational mapping layer that provides a bridge for interacting with SQLite databases. It functions as a database driver that allows for embedded database management and local data persistence within Swift applications. The project distinguishes itself through a type-safe expression builder that verifies SQL statement syntax and intent at compile time. It includes specialized support for high-performance text matching via full-text search integration and provides mechanisms for securing sensitive data through database encryption. The libra
Enables saving application state and indexed data to local disk for persistence across restarts.
Rerun is a multimodal data visualizer and robotics data logger designed for rendering synchronized streams of 3D spatial data, images, and time-series metrics. It functions as a tool for capturing high-frequency sensor data and AI outputs into a queryable columnar format, providing a dedicated interface for viewing MCAP recording files and analyzing physical environments. The project distinguishes itself as a machine learning dataset streamer, capable of feeding logged recordings directly into GPU buffers and PyTorch training pipelines without intermediate exports. It supports a high-performa
Saves high-frequency sensor logs and AI outputs to binary files for offline playback and sharing.
This project is an AI-powered IDE extension and LLM coding assistant that provides a conversational interface for generating, refactoring, and debugging code. It functions as an AI agent framework and a Model Context Protocol client, connecting AI models to external data sources and tools to automate complex development tasks. The system is distinguished by its use of autonomous AI agents capable of multi-step task execution, including the ability to read files, modify code, and run terminal commands iteratively. It supports recursive agent orchestration through subagent delegation and employ
Persists telemetry spans to a local SQLite database for offline inspection and analysis.
This repository contains the HTML specification, which defines the core standards for web page structuring, content organization, and document rendering. It establishes the fundamental algorithms for state-machine-based tokenization, tree construction for the document object model, and origin-based security isolation. The specification provides a framework for defining custom elements with independent lifecycles and registries. It also details the requirements for cross-document communication, session history management, and the synchronization of interface properties with content attributes.
Ensures data remains available across sessions for a specific origin after a browser restart.
Vesktop is an Electron-based desktop client for Discord that runs natively on Linux, offering improved performance and deeper system integration compared to the official web app. It wraps Discord in an Electron shell to provide a lightweight, native desktop experience while adding a privacy protection layer that blocks Discord's access to system-level information such as running processes and hardware details. The client distinguishes itself through comprehensive Linux desktop support, including full Wayland display protocol integration for better performance on modern Linux desktops, screen
Provides a native Electron-based Discord client that runs on Linux without the performance overhead of the official web app.
Noms is a distributed version control database and content-addressable data store. It identifies data by cryptographic hashes to ensure integrity and deduplication, while tracking dataset state changes through a sequence of immutable commits to enable branching, forking, and historical recovery. The system functions as a peer-to-peer data synchronizer, reconciling state between disconnected database instances to ensure all nodes converge on the same data. It distinguishes itself as a schema-flexible document store that supports self-describing types, allowing schemas to evolve and widen as ne
Saves database content to local file systems for durable storage.
Android-Expert is a collection of educational resources and step-by-step instructional materials for learning Android app programming. It provides a comprehensive learning path for building mobile applications using the Kotlin programming language and Android Studio. The material covers the full development lifecycle, from designing interactive user interfaces with lists, cards, and sliders to implementing navigation workflows and screen transitions. It also includes instruction on connecting applications to remote servers to fetch external data and integrating that data into the app flow. T
Provides mechanisms for saving user settings and application state to local disk storage.
This project is a Rust-based AI agent framework and tool orchestrator that provides a command-line interface for interacting with large language models. It functions as an AI tool orchestrator that routes client requests to language servers and manages the planning and handoffs between specialized agents to solve complex tasks. The system distinguishes itself as a language porting validator, using deterministic mocks and specifications to verify feature parity between different language implementations of a codebase. It further extends agent capabilities by acting as a Model Context Protocol
Saves conversation states to local storage and restores them to allow users to continue previous interactions.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Saves in-memory data to local storage periodically to enable full cluster recovery after a planned or unplanned shutdown.
This is a demonstration and template project that applies Clean Architecture principles to SwiftUI application development. It implements a layered architecture that separates presentation, business logic, and data access into independent layers, with unidirectional data flow managed through a single immutable app store that serves as the sole source of truth for all screens. The project distinguishes itself through its implementation of interactor-driven business logic, where all domain rules and workflows live in stateless objects that receive requests and update the central store. Dependen
Stores and retrieves structured data on the device using SwiftData local persistence.
SparkInternals es una referencia técnica y guía de arquitectura que detalla el diseño interno y la implementación del motor de computación distribuida Apache Spark. Sirve como un estudio de análisis de motores de big data, centrándose en cómo el sistema gestiona la ejecución en clúster y la interacción entre nodos driver, ejecutores y workers. El proyecto proporciona un desglose detallado de cómo los planes lógicos se convierten en etapas de ejecución física. Analiza específicamente la mecánica de las operaciones de shuffle de datos, la gestión de memoria y la coordinación de la programación de trabajos distribuidos. La documentación cubre una amplia gama de capacidades de computación distribuida, incluyendo la planificación de ejecución de consultas, la gestión de dependencias de datos y estrategias de caché en memoria. También examina la distribución de tareas, la ejecución paralela y los procesos utilizados para la recuperación ante fallos y la persistencia de datos.
Writes partitioned output records to local disk files to ensure fault tolerance and reduce memory pressure.
Altair es un cliente de API GraphQL gráfico, un entorno de desarrollo integrado (IDE) y un explorador de esquemas. Funciona como una herramienta de depuración y plataforma de colaboración para ejecutar consultas, mutaciones y suscripciones contra servidores GraphQL. El proyecto se distingue por ofrecer espacios de trabajo sincronizados en la nube para organizar y compartir colecciones de consultas entre equipos. Proporciona un framework de extensibilidad flexible que permite la instalación y ejecución de plugins de terceros dentro de sandboxes aislados. La plataforma cubre una amplia gama de capacidades, incluyendo escritura de consultas asistida por IA, exploración visual de esquemas y suscripción de datos en tiempo real mediante múltiples protocolos de transporte. También incluye herramientas para la automatización de solicitudes mediante scripting pre y post-solicitud, así como utilidades para gestionar variables de entorno y analizar metadatos de respuesta. Altair está disponible como aplicación de escritorio, extensión de navegador y aplicación web, y puede alojarse en servidores privados.
Uses local storage to persist values and maintain state across multiple API requests.
Racket es un lenguaje de programación de propósito general y multiparadigma de la familia Lisp, diseñado para la creación de lenguajes. Funciona como un banco de trabajo de lenguajes, proporcionando una plataforma para diseñar e implementar lenguajes de programación personalizados a través de un sistema flexible de macros y módulos. El sistema se distingue por ofrecer una suite integral para la ingeniería de semántica, permitiendo la construcción de subconjuntos de lenguajes especializados y capas educativas. Incluye herramientas para el diseño de lenguajes personalizados, como la generación de lexers y parsers, así como la capacidad de definir reglas de expansión de módulos y selección dinámica de lenguaje en tiempo de lectura. El proyecto proporciona un entorno de desarrollo integrado con un editor incorporado, depurador visual y un gestor de paquetes de software. Su superficie de capacidades se extiende a una biblioteca estándar de propósito general que cubre renderizado de gráficos 2D, procesamiento de datos binarios, integración con SQL y bases de datos deductivas, y la construcción de interfaces gráficas de usuario. El entorno admite la compilación de código fuente en archivos ejecutables independientes para su distribución.
Saves and restores application state to the local file system using serializable structures.
zvec is an embedded vector database engine and indexing library designed for high-dimensional similarity search. It functions as a hybrid search engine and a retrieval-augmented generation knowledge base, allowing for the storage and retrieval of dense and sparse vectors. The system is distinguished by its hybrid retrieval pipeline, which fuses vector similarity, full-text keyword matching, and scalar metadata filtering into single query operations. It supports a plugin-based model integration system for registering custom embedding models and rerankers, as well as language bindings for nativ
Saves collections into dedicated, self-contained directories to ensure isolation and local persistence.
lollms-webui es una interfaz de usuario basada en web y un orquestador de modelos de IA local diseñado para interactuar y gestionar modelos de lenguaje grandes e IA multimodal en hardware local. Funciona como una suite multimedia de IA generativa que permite la creación de texto, imágenes, video y música a través de modelos de difusión y lenguaje integrados. El proyecto cuenta con un gestor de personas dedicado para configurar perfiles de comportamiento y personalidades distintas, controlando el estilo y el tono de las respuestas del modelo. Incluye un sistema de memoria local para mantener el contexto de la conversación a largo plazo y el historial de chat a través de un mecanismo de almacenamiento persistente. El sistema cubre capacidades amplias, incluyendo enrutamiento dinámico de prompts para la optimización de la inferencia, aceleración por GPU y un sistema de vinculación modular para enlazar con proveedores de modelos locales o remotos. También proporciona herramientas para visualizar procesos de razonamiento de IA, gestionar historiales de chat en una base de datos local y extender la interfaz a través de un sistema de herramientas basado en plugins. El despliegue es compatible a través de imágenes contenedorizadas para garantizar una ejecución consistente en diferentes sistemas operativos.
Maps host directories to containers to ensure model files and configurations persist across restarts.