28 Repos
Utilities for maintaining data availability during network outages.
Distinguishing note: Focuses on the offline-first capability rather than general storage.
Explore 28 awesome GitHub repositories matching data & databases · Offline Data Management. Refine with filters or upvote what's useful.
Project Nomad is a self-hosted survival suite and containerized offline operating environment. It provides a collection of essential tools, including a local retrieval-augmented generation system, an offline mapping server, and a local knowledge base for large language models, all designed to operate on air-gapped hardware. The system prioritizes total offline isolation to ensure telemetry-free operation. It enables private data analysis and semantic document querying through local-first vector storage and offline model execution, keeping all data on internal hardware without requiring intern
Provides utilities for downloading and managing regional map datasets for offline searching and navigation.
React-admin is a framework for building data-driven administrative interfaces that connect to REST or GraphQL backends. It provides a comprehensive suite of tools for managing the full lifecycle of administrative applications, including resource-oriented routing, declarative form scaffolding, and context-driven state management. By utilizing a modular adapter-based architecture, the framework abstracts backend communication, allowing developers to build consistent CRUD interfaces that handle data fetching, authentication, and synchronization automatically. The project distinguishes itself thr
Caches data locally to allow users to continue working without an active network connection and syncs changes when back online.
This project is an asynchronous key-value store designed for client-side data persistence. It provides a unified interface that allows applications to save and retrieve complex data types, including binary objects, while maintaining responsiveness through non-blocking operations. By enabling offline-first functionality, it ensures that data remains accessible even when a network connection is unavailable. The library distinguishes itself through a driver-based abstraction layer that automatically detects the most efficient storage mechanism available in the current browser or mobile environme
Saves and retrieves complex data types in a local key-value store that remains accessible offline.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Maintains application functionality and data availability without an active internet connection to ensure uninterrupted user productivity.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Exports data from a source database and imports it into a target instance, ensuring data consistency while requiring brief downtime during the transfer process.
This project is a local-first task manager and time tracking tool designed to consolidate work items from multiple external project management platforms into a single, unified interface. By prioritizing local data sovereignty, it ensures that all task lists, time logs, and application states remain on the user's device, providing full functionality in offline environments while maintaining privacy. The application distinguishes itself through a focus on deep work and structured productivity rituals. It integrates distraction-free modes, configurable focus timers, and automated time tracking t
Supports secure, user-managed synchronization across devices using local encryption.
Organic Maps is a mobile application designed for offline mapping, navigation, and outdoor activity planning. It functions as a privacy-focused client for OpenStreetMap data, enabling users to explore locations, search for points of interest, and receive turn-by-turn directions entirely without an internet connection. The project distinguishes itself through a strict zero-telemetry privacy model that excludes trackers, data collection, and mandatory account requirements. By utilizing a native core engine and local-first data storage, it ensures that all user activity, location history, and pe
Supports downloading map data directly to local devices to enable searching and navigation without network connectivity.
Mapbox GL JS ist eine WebGL-Karten-Rendering-Engine und ein interaktives Webkarten-Framework, das zum Rendern von Vektorkacheln, Rasterbildern und 3D-Gelände im Browser verwendet wird. Es fungiert als Vektorkachel-Kartenbibliothek und Tool zur Visualisierung von Geodaten und nutzt GPU-beschleunigte Shader, um Geodaten in interaktive Karten umzuwandeln. Das Projekt zeichnet sich durch die Integration benutzerdefinierter WebGL-Layer direkt in die Rendering-Pipeline und die Verwendung datengesteuerter Ausdrücke aus, um Feature-Eigenschaften auf visuelle Attribute abzubilden. Es unterstützt spezialisiertes Datenladen über PMTiles und bietet Offline-Kartenverwaltung durch lokale Pakete und Datenbanken. Die Engine deckt ein breites Spektrum an Funktionen ab, darunter 3D-Gelände- und Gebäuderendering mit Beleuchtung und Schatten, Echtzeit-Verfolgung des Benutzerstandorts und programmierbare Kameraanimationen. Sie bietet räumliche Abfragen für den Abruf von Features, dynamische Filterung und ein UI-System für HTML-Marker und Informations-Popups. Die Bibliothek enthält Build-Konfigurationen zur Erstellung von Bundles, die Content-Security-Policy-Beschränkungen für Web-Worker erfüllen.
Provides utilities for managing regional map datasets to enable offline viewing and navigation.
SpotiFlyer is a cross-platform media utility designed to aggregate music from multiple streaming services into a single, unified library. It functions as a music downloader and offline audio manager, allowing users to save tracks directly to local device storage for playback without an active internet connection. The application utilizes a plugin-based provider architecture to normalize metadata from diverse external sources, enabling the consolidation of content into a consistent format. This modular design supports the integration of custom modules and external services, which expands the c
Saves and organizes media files from streaming services to local storage for consistent access without an internet connection.
PiliPlus is a third-party media player designed for the Bilibili platform, providing a unified interface for video streaming, live content consumption, and community interaction. It functions as a cross-platform application that synchronizes user accounts, playback preferences, and social data across mobile and desktop devices. The application distinguishes itself through advanced playback features, including real-time scrolling comment overlays that simulate a communal viewing experience. It incorporates local-first media caching to store assets directly on the device, which reduces latency
Manages media libraries with playlists, watch history, and offline caching capabilities.
Popcorn Time is a cross-platform application that functions as a BitTorrent streaming client, enabling the playback of movies and television shows through sequential data downloading. It serves as a comprehensive media discovery platform and metadata API, providing tools to search, browse, and retrieve detailed information about entertainment content. The platform distinguishes itself through a robust streaming data provider service that maps regional streaming availability and resolves encrypted tokens into secure redirects for external media platforms. It supports global audiences by locali
Maintains data availability for offline analysis by providing periodic snapshots of the entire media database.
PySyft is a privacy-preserving machine learning framework and remote computation engine. It functions as a decentralized data analysis orchestrator that allows for the execution of data science workflows on remote servers without requiring the transfer of raw private data from the host device. The platform provides a secure collaboration environment where data owners manage permissions and authorize specific collaborators to run computations. It differentiates its workflow by utilizing mock data for local development and validation before submitting final analysis jobs to private remote serve
Maintains functionality while peers are offline and automatically synchronizes changes once connectivity returns.
This project is a JavaScript library and SDK used to integrate web and mobile applications with cloud services. It serves as a bridge to backend providers for user authentication, binary object storage, and real-time data synchronization. The library provides a unified interface for managing cloud identity and access, executing queries and mutations against GraphQL endpoints, and consuming REST APIs with secure request signing. It also includes tools for accessing machine learning services for natural language processing and computer vision. Broad capability areas include offline-first data
Provides utilities to maintain application data availability and functionality during network outages.
Mapscii is a terminal-based geographic interface and vector map renderer. It allows users to view and explore geographic map data and points of interest directly within an xterm-compatible console using ASCII and Braille characters. The project functions as a vector tile map client capable of fetching and styling geographic layers from public or private sources. It also serves as an MBTiles map viewer, enabling the exploration of geographic data stored in local files for offline use. The tool provides keyboard-driven navigation for zooming and panning across coordinates, along with the abili
Enables navigation of geographic data stored in local MBTiles files for offline use.
RedisInsight is a graphical user interface and management tool for browsing, analyzing, and administering Redis databases. It provides a visual environment for exploring key-value data structures, managing database instances, and performing data analysis across different operating systems and deployments. The tool distinguishes itself by providing dedicated visual managers for complex operations, including a vector database manager for configuring embeddings and similarity searches, a query workbench for executing raw commands and Lua scripts, and a performance monitoring dashboard for tracki
Provides utilities to export datasets from a source server and import them into a target database.
AngularFire is a set of tools for connecting applications to Firebase services. It provides a library of client-side interfaces for managing authentication, object storage, NoSQL databases, and serverless functions. The project utilizes observables and dependency injection to integrate cloud services into the application hierarchy. It features a reactive interface for streaming real-time data, managing document-based databases, and tracking authentication state as a continuous stream of tokens. The platform covers a broad range of cloud capabilities, including identity verification, binary f
Caches database content locally so the application remains functional during network outages.
X-Track is a firmware project for an embedded bicycle computer that combines GPS-based speed and ride metrics with offline map navigation. It functions as a GPS bicycle speedometer, displaying speed, distance, altitude, and other ride data on a handlebar-mounted screen, while also serving as an offline map viewer that renders locally stored map tiles without an internet connection. The project distinguishes itself by including a firmware emulator that runs the embedded code on a PC, enabling development and testing without physical hardware. It also provides GPS-based clock calibration to aut
Download map tiles for a chosen geographic region at user-selected zoom levels and store them as PNG files in a MAP folder.
CloudReader ist ein Android-Musik-Client für das Streaming von Musik und den Konsum von Cloud-Inhalten. Er ist als Material-Design-Anwendung implementiert und bietet eine spezialisierte Schnittstelle für Cloud-Musik-Streaming und das Durchsuchen digitaler Medien. Die Anwendung verfügt über eine Cloud-Musik-Streaming-Schnittstelle und ein Content-Browsing-System zum Erkunden von Artikeln, Community-Foren und Frage-Antwort-Bereichen. Sie enthält Dienstprogramme für die Inhaltssuche, die Verfolgung des Suchverlaufs und die Erstellung von Desktop-Verknüpfungen für den schnellen Zugriff auf bestimmte Anwendungsbereiche. Das System unterstützt visuelle Anpassungen durch einen Dark Mode und eine standardisierte Designsprache. Es integriert lokales Datenmanagement, um den Offline-Zugriff auf zwischengespeicherte Informationen zu ermöglichen.
Ensures data availability during network outages by caching content in a local Room database.
Colanode ist eine Local-First-Kollaborationsplattform, die für gemeinsam genutzte Dokumente, Chats und Datenbanken entwickelt wurde. Sie bietet eine selbstgehostete Suite für Team-Zusammenarbeit und Wissensmanagement, die es Benutzern ermöglicht, die volle Kontrolle über ihre Daten und Privatsphäre auf ihrer eigenen Infrastruktur zu behalten. Die Plattform zeichnet sich durch eine Synchronisierungs-Engine aus, die WebSockets für die Echtzeit-Datenübertragung nutzt, sowie durch einen Local-First-Ansatz, der sicherstellt, dass die Arbeit auch offline fortgesetzt werden kann. Sie integriert KI-gestützten Abruf durch vektorbasierte semantische Suche, was es Benutzern ermöglicht, Informationen basierend auf der Bedeutung über Dokumente und Nachrichten hinweg zu finden. Das System deckt ein breites Spektrum an Funktionen ab, einschließlich kollaborativer Rich-Text-Bearbeitung, hierarchischer Inhaltsmodellierung und strukturierter Datenbankverwaltung mit Ansichten wie Kanban-Boards und Kalendern. Es verwaltet Medien über einen S3-kompatiblen Dokumentenspeicher und organisiert Entitäten in flexiblen Eltern-Kind-Beziehungen. Die Software ist über Docker Compose oder Kubernetes mittels Helm-Charts bereitstellbar und unterstützt die Integration mit externen Reverse-Proxys für das Routing von Produktions-Traffic.
Creates globally unique, time-sortable identifiers on the client side to enable offline data creation.
Incus is a unified orchestration platform for managing system containers, OCI application containers, and virtual machines through a single control plane. It brings together cluster infrastructure management, secure multi-tenancy, software-defined networking, and pluggable storage backend orchestration into one cohesive system exposed via a full REST API and command-line interface. What distinguishes Incus is its ability to run multiple instance types side by side—full Linux system containers, OCI application containers, and QEMU virtual machines—all managed with consistent tooling. Networkin
Supports stateful snapshots and live migration of instances with incremental transfer between hosts.