46 Repos
Software abstractions that provide a dedicated interface for interacting with underlying database or storage systems.
Explore 46 awesome GitHub repositories matching data & databases · Data Storage Layers. Refine with filters or upvote what's useful.
Grafana is an observability data platform designed to aggregate metrics, logs, and traces from diverse sources into a unified environment. It functions as a centralized interface for visualizing complex telemetry data, transforming raw streams into interactive dashboards that support real-time system health tracking and performance monitoring. The platform distinguishes itself through a plugin-based modular architecture that integrates disparate databases, cloud services, and monitoring tools via a standardized data abstraction layer. This framework allows for the dynamic loading of external
Persists system configuration and state metadata in a relational schema to ensure consistency across distributed deployments.
Gitea is a self-hosted service designed for managing version control repositories, project issue tracking, and software artifact distribution. It provides a collaborative platform that enables teams to host their own source code, manage development tasks through integrated project boards, and store container images or language-specific packages within a unified environment. The platform distinguishes itself through a built-in automation engine that executes continuous integration and delivery pipelines directly triggered by repository events. It utilizes a background task queue to manage asyn
Map application objects to a relational database schema to ensure consistent data persistence and storage integrity.
Shardeum is an autoscaling blockchain infrastructure designed to distribute network workloads across multiple shards to increase throughput. It uses a dynamic-sharding architecture that horizontally scales node capacity and adjusts the number of active shards based on real-time network demand. The system features an execution environment compatible with the Ethereum Virtual Machine, allowing it to run smart contracts and decentralized applications. It maintains network agreement and security through consensus-group partitioning, which organizes validator nodes into discrete groups. The platf
Implements a durable storage layer with an integrated cache to track account balances and transaction history.
Harbor is a self-hosted, enterprise-grade container registry platform designed to store, sign, and scan container images and cloud-native artifacts. It provides a centralized repository that integrates directly with Kubernetes environments to manage the full lifecycle of software artifacts, from initial storage to production deployment. The platform distinguishes itself through a focus on security, governance, and multi-site availability. It features a pluggable vulnerability scanning framework that allows for the integration of various security engines, alongside content trust mechanisms tha
Uses relational database schemas to maintain consistent storage of artifact manifests, permissions, and audit logs.
This project is a full-stack React starter kit and TypeScript web application boilerplate. It provides a pre-configured project template that combines a frontend and backend to accelerate the development of production-ready web applications. The kit is distinguished by its focus on type-safe architectures, utilizing a monorepo structure to synchronize data types between the server and client. It integrates specific implementations for SaaS operations, including recurring subscription billing via Stripe and user identity authentication supporting passkeys, social logins, and email verification
Implements a schema-driven persistence layer that manages relational data storage and automated migrations.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Provides a flexible storage layer that enables consistent data management across web browsers, mobile apps, and desktop environments.
Phoenix is a server-side web framework built for the Elixir programming language and the Erlang virtual machine. It provides a structured environment for developing applications using the model-view-controller pattern, enabling developers to manage data, render user interfaces, and handle incoming requests within a scalable, process-based architecture. The framework distinguishes itself as a platform for real-time web communication, utilizing persistent bidirectional connections to broadcast live updates to clients. It incorporates a dedicated abstraction layer for relational database integra
Maps application data structures to relational database systems while simplifying query and schema management.
This project is a cross-platform development framework and managed runtime environment designed for building high-performance applications. It provides a comprehensive toolkit for constructing web services, cloud-native microservices, and desktop applications, utilizing a unified runtime that handles memory management and execution across diverse operating systems. The framework distinguishes itself through a native ahead-of-time compilation toolchain that transforms source code into optimized, self-contained machine code binaries. This capability enables fast startup times and reduced memory
Maps application objects to database schemas and handles data persistence.
Navidrome is a self-hosted music streaming server designed to organize, index, and stream personal digital music collections. It functions as a centralized audio streaming platform that manages local audio files, automatically enriching them with metadata and artwork while providing a web interface for playback. The system supports multi-user access, allowing administrators to manage separate collections and listening histories with granular permissions. The platform distinguishes itself through its compatibility with the Subsonic API, enabling users to connect a wide range of third-party mus
Uses a relational database to map file tags and persistent identifiers for efficient library organization.
This project provides a structured curriculum and visual guide for mastering web development within the ASP.NET Core ecosystem. It serves as a comprehensive roadmap that maps out the essential technologies, milestones, and proficiency sequences required for developers to progress from beginner to advanced levels. The repository distinguishes itself by curating high-quality learning resources and technical documentation into a logical progression. It visualizes complex development paths through structured diagrams, helping users navigate the technical requirements of building and maintaining m
Integrates relational and NoSQL databases using object-relational mapping for data persistence.
Taxonomy is a full-stack application template and reference implementation built with the Next.js app router. It serves as a comprehensive starter for developing web applications using server components and modern React patterns. The project integrates a variety of specialized systems, including an identity management workflow for OAuth and session handling, and a billing system for managing recurring subscriptions and payment events. It also features a content pipeline that transforms Markdown and JSX files into type-safe data collections for rendering blogs and documentation. The architect
Implements a persistence layer using a relational database and ORM for structured application state.
Taxonomy is a SaaS boilerplate and Next.js application template designed for building subscription-based web applications. It provides a foundational architecture implemented as a TypeScript web framework, utilizing server components and app-router file routing. The project serves as a comprehensive starter for software-as-a-service products, combining user authentication workflows with recurring subscription billing. It further functions as a markdown content site, enabling the creation of blogs or documentation through markdown-to-HTML rendering. The codebase integrates several core capabi
Implements a relational persistence layer using database schemas and object-relational mapping for structured data.
Luigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a workflow orchestration engine that organizes tasks into directed acyclic graphs, ensuring that jobs execute in the correct logical order based on their dependencies. By utilizing a centralized scheduler, the system coordinates task execution across distributed environments, tracks global workflow state, and prevents redundant processing by verifying the existence of output targets before triggering any work. The project distinguishes itself through a robust state-tracking mechanism t
Provides a unified abstraction layer for interacting with various storage systems including local files and databases.
This project is a cross-platform managed execution environment and general-purpose application framework designed for building high-performance software. It provides a unified runtime that handles memory management, type safety, and code execution across diverse operating systems. By integrating a native code compilation toolchain, the platform enables developers to convert managed code into optimized machine instructions, significantly improving startup performance and reducing runtime dependencies for production environments. The framework distinguishes itself through a comprehensive toolch
Connects applications to relational databases using object-relational mapping for state synchronization.
This project is a Spring Boot reference implementation and learning resource designed to demonstrate the core features and architectural patterns of the Spring framework. It serves as a Java enterprise application template and boilerplate for building RESTful APIs, providing a structured codebase for practicing application development. The repository provides practical examples of microservices architecture orchestration, including the use of service discovery and inter-service communication to coordinate distributed services. It also implements reference patterns for RESTful API design with
Implements a layered persistence architecture using repositories to separate business logic from relational database interactions.
Beets is a command-line music library manager that automates the organization, standardization, and maintenance of digital audio collections. It functions as a relational database-backed system that identifies audio content through acoustic fingerprinting and retrieves accurate metadata from online databases to ensure consistent tagging and directory structures. The project distinguishes itself through an event-driven pipeline architecture and a modular plugin system, which allow users to intercept and customize library processing workflows. This extensibility enables the integration of exter
Uses a relational database to maintain persistent associations between audio files and metadata.
NodeBB is a real-time, self-hosted community forum platform built on Node.js. It is designed to support scalable discussion environments by utilizing a document-oriented database for content storage and an in-memory engine for high-speed data retrieval and session management. The platform provides a comprehensive administrative interface for managing user groups, forum settings, and system health. What distinguishes the platform is its native support for federated social networking via the ActivityPub protocol, allowing forums to exchange content, synchronize discussions, and interact with de
Persists forum content and user information by connecting to supported database backends through an abstraction layer.
JuiceFS is a distributed file system designed to mount object storage as a local, POSIX-compliant drive. It functions as a cloud-native persistent storage layer that decouples file metadata from raw data, storing metadata in a transactional database while keeping data blocks in object storage. This architecture enables multiple hosts across different regions to access the same storage simultaneously while maintaining strong consistency. The system distinguishes itself by performing data processing, including compression and encryption, directly on the client side before transmission. By split
Connects storage layers directly to distributed computing tools using standard protocols.
Juice Shop is a self-contained web application designed as a platform for cybersecurity education and security training. It functions as a controlled environment containing intentional security flaws, allowing users to practice offensive security techniques and defensive coding practices while tracking their progress through a live scoreboard. The platform serves as an industry-standard benchmark for evaluating the effectiveness and detection accuracy of automated security scanning tools. By hosting a standardized set of known vulnerabilities and common attack patterns, it provides a reliable
Uses an object-relational mapping layer to persist user progress and challenge states in a database.
OpenALPR is a computer vision platform designed to identify vehicle license plates and attributes from live video streams or static images. It functions as an intelligent access control and analytics system, enabling the automation of security monitoring, parking facility management, and operational workflows through real-time vehicle detection. The platform distinguishes itself by supporting international license plate formats and regional configuration mapping, allowing for deployment across diverse geographic standards. It integrates directly with existing network camera infrastructure, pe
Stores vehicle detection logs and metadata in structured databases for historical querying and reporting.