awesome-repositories.com
Blog
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetÀ proposNotre méthodologiePresseServeur MCP
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

62 dépôts

Awesome GitHub RepositoriesData Persistence

Wrappers for managing local state and cloud synchronization.

Distinguishing note: Focuses on data modeling and persistence.

Explore 62 awesome GitHub repositories matching data & databases · Data Persistence. Refine with filters or upvote what's useful.

Awesome Data Persistence GitHub Repositories

Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
  • openai/openai-agents-pythonAvatar de openai

    openai/openai-agents-python

    27,191Voir sur GitHub↗

    This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services

    Ensures context availability across process restarts by saving conversation history to local or remote storage.

    Pythonagentsaiframework
    Voir sur GitHub↗27,191
  • gopeedlab/gopeedAvatar de GopeedLab

    GopeedLab/gopeed

    24,975Voir sur GitHub↗

    Gopeed is a cross-platform download manager that provides a unified interface for retrieving files across diverse protocols, including HTTP, BitTorrent, Magnet, and ED2K. It utilizes a multi-segment concurrent downloading engine to maximize network bandwidth utilization and accelerate transfer speeds. The application is designed for both desktop and mobile environments, offering a terminal-based command-line interface alongside a graphical user experience. The project distinguishes itself through a scriptable extension framework that allows users to execute custom JavaScript to automate compl

    Maintains local state and authentication tokens across extension execution sessions.

    Goandroidbittorrentcross-platform
    Voir sur GitHub↗24,975
  • toon-format/toonAvatar de toon-format

    toon-format/toon

    24,642Voir sur GitHub↗

    Toon is a data serialization library and toolkit designed to convert complex objects into compact, human-readable formats optimized for large language models. By focusing on token efficiency, the library minimizes the context window footprint of structured data through techniques like key folding and tabular layout optimization. It provides a streaming-capable processor that handles the encoding and decoding of hierarchical data while maintaining structural integrity. The project distinguishes itself through its path-aware transformation pipeline and configurable serialization logic, which al

    Maps objects to compact, serialized formats to enable consistent data persistence across different programming environments.

    TypeScriptdata-formatllmserialization
    Voir sur GitHub↗24,642
  • ipfs/ipfsAvatar de ipfs

    ipfs/ipfs

    23,137Voir sur GitHub↗

    IPFS is a peer-to-peer hypermedia protocol and content-addressed storage system that identifies data by cryptographic hashes rather than network locations. It enables the creation of a decentralized web by organizing files and directories as directed acyclic graphs of linked content identifiers. The project differentiates itself through the use of a distributed hash table for locating peers and a system of signed records to map human-readable names to changing content. It also provides HTTP gateways that translate standard web requests into peer-to-peer queries, allowing decentralized data to

    Manages the lifecycle of internal data blocks, including removal and reclamation of local storage space.

    ipfsipfs-protocolipfs-web
    Voir sur GitHub↗23,137
  • redis/go-redisAvatar de redis

    redis/go-redis

    22,159Voir sur GitHub↗

    This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha

    Ensures data durability across restarts by using snapshots or append-only logs while maintaining high-speed in-memory performance.

    Gogogolangredis
    Voir sur GitHub↗22,159
  • thangchung/awesome-dotnet-coreAvatar de thangchung

    thangchung/awesome-dotnet-core

    21,277Voir sur GitHub↗

    This project is a curated, community-driven directory of frameworks, libraries, and development tools designed for the .NET ecosystem. It serves as a comprehensive resource index for developers seeking to build, maintain, and scale software projects using .NET technologies. The collection provides a structured catalog of utilities that support the full software development lifecycle. It covers essential capability areas including web service development, data persistence integration, and system observability. The directory also highlights tools for managing application dependencies, implement

    Features a collection of database drivers and migration tools for managing data persistence in .NET projects.

    C#awesomeawesome-listcsharp
    Voir sur GitHub↗21,277
  • allinurl/goaccessAvatar de allinurl

    allinurl/goaccess

    20,242Voir sur GitHub↗

    This project is a terminal-based log analyzer and real-time traffic monitoring system designed for web server environments. It processes raw server access logs to generate structured statistical insights, providing visibility into visitor behavior, bandwidth usage, and request latency. The tool functions as a high-performance utility capable of handling large-scale datasets through multi-threaded parsing and memory-efficient data structures. The software distinguishes itself by offering both an interactive terminal interface and a web-based dashboard that updates in real-time via WebSocket st

    Maintains analysis state across sessions by storing and restoring datasets on disk to avoid redundant processing after restarts.

    Canalyticsapachec
    Voir sur GitHub↗20,242
  • nats-io/nats-serverAvatar de nats-io

    nats-io/nats-server

    20,076Voir sur GitHub↗

    NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t

    Store message sequences to enable temporal decoupling, allowing subscribers to replay historical data or consume messages as a work queue.

    Gocloudcloud-computingcloud-native
    Voir sur GitHub↗20,076
  • blender/blenderAvatar de blender

    blender/blender

    18,787Voir sur GitHub↗

    Blender is a professional 3D creation suite designed for modeling, animation, rendering, and video editing. It functions as an open-source 3D engine that provides a comprehensive framework for procedural geometry, physics simulation, and high-quality visual output. The platform is built upon a foundational architecture that utilizes data-block-based memory management and a dependency-graph-based evaluation system to handle complex scene transformations and geometry updates. The software distinguishes itself through a highly modular, node-based procedural architecture that allows users to cons

    Manages the lifecycle of core data structures representing persistent assets and UI states.

    C++3danimationb3d
    Voir sur GitHub↗18,787
  • fastapi/sqlmodelAvatar de fastapi

    fastapi/sqlmodel

    18,137Voir sur GitHub↗

    SQLModel is a type-safe object-relational mapping library for Python that integrates database schema definitions with data validation logic. By combining these two roles into a single class, it allows developers to manage relational data structures and enforce data integrity for web APIs simultaneously. The framework is built to support asynchronous database operations, enabling high-performance applications to execute queries and transactions without blocking the main execution thread. The library distinguishes itself by leveraging Python type hints to provide IDE autocompletion and compile-

    Saves instances of data models to a connected database by managing sessions and committing changes to the underlying storage.

    Pythonfastapijsonjson-schema
    Voir sur GitHub↗18,137
  • nodebb/nodebbAvatar de NodeBB

    NodeBB/NodeBB

    15,144Voir sur GitHub↗

    NodeBB is a real-time, self-hosted community forum platform built on Node.js. It is designed to support scalable discussion environments by utilizing a document-oriented database for content storage and an in-memory engine for high-speed data retrieval and session management. The platform provides a comprehensive administrative interface for managing user groups, forum settings, and system health. What distinguishes the platform is its native support for federated social networking via the ActivityPub protocol, allowing forums to exchange content, synchronize discussions, and interact with de

    Stores user profiles, discussion topics, posts, and global configuration settings using structured key-value pairs.

    JavaScriptcommunityforumjavascript
    Voir sur GitHub↗15,144
  • boltdb/boltAvatar de boltdb

    boltdb/bolt

    14,642Voir sur GitHub↗

    Bolt is a single-file embedded key-value store for Go applications. It is an ACID transactional database that organizes data in B+trees on disk to provide efficient sorted key retrieval and range scans. The system uses a memory-mapped model to map the database file directly into the process address space for fast random-access reads. The project distinguishes itself through a multi-version concurrency control architecture that allows multiple simultaneous readers to access a consistent snapshot of data without blocking a writer. It employs a single-writer multi-reader locking model and uses a

    Reclaims unused data pages and organizes storage blocks to optimize the allocation of new data.

    Go
    Voir sur GitHub↗14,642
  • sairyss/domain-driven-hexagonAvatar de Sairyss

    Sairyss/domain-driven-hexagon

    14,395Voir sur GitHub↗

    This project is a TypeScript-based architectural framework designed to implement domain-driven design and hexagonal architecture in enterprise applications. It provides a structured boilerplate that isolates core business logic from infrastructure concerns, ensuring that domain entities, use cases, and external technology adapters remain decoupled and maintainable. The framework distinguishes itself by enforcing strict architectural boundaries and dependency inversion, preventing unauthorized access to core logic from external layers. It utilizes a command-query responsibility segregation pat

    Standardizes database operations by enforcing a consistent interface for entity persistence and retrieval across different modules.

    TypeScriptarchitectural-patternsarchitecturebackend
    Voir sur GitHub↗14,395
  • open-metadata/openmetadataAvatar de open-metadata

    open-metadata/OpenMetadata

    14,213Voir sur GitHub↗

    OpenMetadata is an enterprise data catalog, metadata platform, and governance suite that functions as a knowledge graph for data assets. It serves as an AI-ready metadata layer, providing governed context and organizational memory to large language model agents via the Model Context Protocol. The platform distinguishes itself by capturing institutional knowledge, linking conversations, decisions, and remediation notes directly to data assets to preserve tribal knowledge. It integrates AI agents to automate metadata governance, such as suggesting descriptions and identifying sensitive data thr

    Implements formal agreements between data producers and consumers to enforce schema expectations and quality SLAs.

    TypeScriptcontextcontext-layerdata-catalog
    Voir sur GitHub↗14,213
  • memcached/memcachedAvatar de memcached

    memcached/memcached

    14,132Voir sur GitHub↗

    Memcached is a high-performance, distributed, in-memory key-value storage and request routing engine. It functions as a volatile data store designed to accelerate dynamic applications by caching objects in RAM, thereby reducing backend database load and providing sub-millisecond response times. The system utilizes a specialized architecture that organizes memory into fixed-size slabs to minimize fragmentation and maximize throughput for high-concurrency workloads. The project distinguishes itself through a multi-threaded, lock-friendly design that scales across CPU cores and supports complex

    Saves key-value pairs in memory, allowing for unconditional overwrites or updates based on existing data presence.

    C
    Voir sur GitHub↗14,132
  • dbt-labs/dbt-coreAvatar de dbt-labs

    dbt-labs/dbt-core

    13,051Voir sur GitHub↗

    dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d

    Defines explicit schemas and expectations for data models to prevent breaking changes from propagating to downstream consumers.

    Rustanalyticsbusiness-intelligencedata-modeling
    Voir sur GitHub↗13,051
  • formbricks/formbricksAvatar de formbricks

    formbricks/formbricks

    12,391Voir sur GitHub↗

    Formbricks is an open-source survey and feedback platform designed to help teams capture and analyze user insights through targeted, in-app, and website-based interactions. It functions as a comprehensive customer experience analytics system that allows organizations to maintain full control over their data, user attributes, and survey workflows. The platform distinguishes itself through its event-driven architecture, which enables precise behavioral targeting by triggering surveys based on specific user actions or application events. It supports deep integration with external ecosystems by a

    Persists survey definitions, user responses, and organizational data in a relational database to ensure data integrity.

    TypeScriptexperience-managementformforms
    Voir sur GitHub↗12,391
  • datahub-project/datahubAvatar de datahub-project

    datahub-project/datahub

    12,141Voir sur GitHub↗

    DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

    Establishes formal agreements between data producers and consumers to define expected data structure and reliability standards.

    Pythondata-catalogdata-discoverydata-governance
    Voir sur GitHub↗12,141
  • twinproduction/gatusAvatar de TwinProduction

    TwinProduction/gatus

    11,255Voir sur GitHub↗

    Gatus is a multi-protocol health checker and automated service alerting tool. It provides a monitoring dashboard for tracking the uptime and health of HTTP, TCP, DNS, and gRPC endpoints, and serves as a Prometheus metrics exporter to track response times and success rates. The project distinguishes itself with a developer-oriented approach to status pages, securing administrative access and dashboards via OpenID Connect and Basic Authentication. It supports complex network environments through SSH tunneling to monitor internal services via bastion hosts and allows remote agents to push health

    Persists health check results and events for historical tracking and dashboard visualization.

    Go
    Voir sur GitHub↗11,255
  • magicalpanda/magicalrecordAvatar de magicalpanda

    magicalpanda/MagicalRecord

    10,713Voir sur GitHub↗

    MagicalRecord is a data persistence library and wrapper for Core Data that implements the Active Record pattern. It maps database rows directly to object instances, allowing for the creation, update, and retrieval of records without writing manual query logic. The project functions as a mapping layer that synchronizes object properties with a managed object context. It utilizes generic-based type resolution and model-class querying to enable data fetching directly on model classes, which removes the need for a separate external manager and reduces repetitive fetch request boilerplate. The li

    Simplifies local record persistence using a direct object mapping pattern to reduce manual data handling.

    Objective-C
    Voir sur GitHub↗10,713
Préc.123…4Suivant
  1. Home
  2. Data & Databases
  3. Data Persistence

Explorer les sous-tags

  • AISpecialized data modeling for persisting AI messages and chat associations in databases. **Distinct from Data Persistence:** Focuses specifically on the schema and associations for AI interactions rather than general cloud/local synchronization
  • Analysis State PersistenceMechanisms for storing and restoring analytical datasets on disk to maintain state across sessions. **Distinct from Data Persistence:** Distinct from general Data Persistence: focuses on preserving analytical state for log processing rather than general database modeling.
  • Data Access Contracts1 sous-tagStandardizes database operations by enforcing a consistent interface for entity persistence and retrieval. **Distinct from Data Persistence:** Focuses on architectural contracts for persistence rather than general data persistence.
  • Data-Block ManagementSystems for creating, duplicating, and deleting persistent data structures within a production environment. **Distinct from Data Persistence:** Distinct from Data Persistence: focuses on the lifecycle of internal data-blocks rather than general storage persistence.
  • Filesystem BufferingLocal disk-based buffering of data to ensure reliability and prevent loss during system failures. **Distinct from Data Persistence:** Specifically implements a temporary filesystem buffer for data pipeline reliability, not general application state persistence.
  • Local Persistence ImplementationsPractical examples of implementing local storage using key-value stores and relational databases. **Distinct from Data Persistence:** Distinct from Data Persistence: focuses on the concrete implementation of local storage on-device rather than general data modeling.
  • Persistence MarkersMechanisms for marking specific data as critical to prevent its deletion during automated cleanup. **Distinct from Data Persistence:** Distinct from general Data Persistence: specifically about marking data as 'important' to survive a garbage collection cycle.
  • ReasoningSaving model internal deliberation steps and thinking process data for auditing and cost analysis. **Distinct from Data Persistence:** Targets the persistence of 'thinking' tokens and reasoning traces specifically, not general application state
  • Scientific Array SerializationSpecialized persistence methods for saving and loading multidimensional arrays in formats like NPY, CSV, and JSON. **Distinct from Data Persistence:** Focuses specifically on multidimensional array formats (NPY, CSV) for scientific exchange rather than general local state or cloud sync.
  • SecurePersistence mechanisms that combine data storage with security guarantees like memory locking and integrity checks. **Distinct from Data Persistence:** Distinct from general Data Persistence: adds cryptographic integrity and memory leak prevention to the storage process.
  • Serialization ExclusionsCapabilities to mark specific attributes or components to be ignored during the data save process. **Distinct from Data Persistence:** Distinct from general Data Persistence; this is the specific act of excluding fields from the serialization stream.
  • Session-Scoped Data StoresMechanisms for saving user-generated data to files or databases so it survives server restarts and is available across sessions. **Distinct from Data Persistence:** Distinct from general Data Persistence: focuses on user-generated application data that persists across server restarts and is shared among multiple sessions, not on low-level storage wrappers.
  • Variable PersistencePersistence of individual pipeline variables and artifacts for recovery and cross-environment sharing. **Distinct from Data Persistence:** Distinct from general Data Persistence by focusing on the persistence of flow-specific instance variables.