21 Repos
Unified interfaces for managing file operations across diverse storage backends.
Distinguishing note: Focuses on the abstraction layer for storage rather than specific database implementations.
Explore 21 awesome GitHub repositories matching data & databases · Storage Abstractions. Refine with filters or upvote what's useful.
Puter is a browser-based desktop environment and cloud-native development platform that provides a virtualized graphical workspace. It enables developers to build and deploy full-stack web applications by integrating cloud storage, authentication, and serverless backend logic directly into the browser, eliminating the need for traditional server infrastructure. The platform distinguishes itself through a unified cloud storage layer and a distributed network runtime that facilitates peer-to-peer communication and cross-origin resource fetching. It features a sophisticated cross-window orchestr
Maps remote storage operations to a consistent interface accessible by all hosted applications.
This project is a command-line utility designed for secure, content-addressable data archiving. It functions as an encrypted backup tool that stores data as deduplicated chunks, ensuring that every piece of information is identified by a cryptographic hash to maintain integrity across all backups. By applying strong encryption and message authentication codes to both data and metadata, the software prevents unauthorized access and detects potential tampering. The tool distinguishes itself through a backend-agnostic storage abstraction that allows users to maintain repositories across diverse
Translates high-level repository operations into specific protocols for local filesystems or remote cloud storage providers.
Postiz is an open-source social media management platform designed to centralize the scheduling, publishing, and analysis of content across diverse social networks, community forums, and blogging platforms. It functions as a unified hub where users can coordinate, review, and distribute content through a shared team workspace, while leveraging integrated artificial intelligence to assist in drafting text and generating multimedia assets. The platform distinguishes itself through a modular architecture that utilizes a provider-specific adapter pattern to ensure consistent content distribution
Provides a consistent interface for uploading and retrieving assets across local filesystems or cloud-based object storage providers.
Cloudreve is a self-hosted cloud storage platform designed to provide personal and organizational file management. It functions as a web-based solution that allows users to store, organize, and share digital files across multiple devices while maintaining control over their own data infrastructure. The platform distinguishes itself through a storage backend abstraction layer, which provides a unified interface to manage files across diverse local and remote cloud providers. It incorporates a robust identity and authorization layer that supports standard OAuth 2.0 flows for secure third-party
Provides a unified interface to manage files across diverse local and remote cloud storage providers through a common set of operations.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Offers a modular storage interface for switching backends without changing application code.
Cap is a self-hosted screen recording and video collaboration platform designed for teams to replace synchronous meetings with asynchronous video updates. It provides a comprehensive suite for capturing high-resolution desktop activity, including system audio, microphone input, and camera overlays, which are then processed through an integrated post-production workflow. The platform distinguishes itself by offering full data sovereignty through containerized deployment and object storage abstractions, allowing users to host their media assets on private infrastructure or S3-compatible buckets
Provides a storage abstraction layer to support local disks or S3-compatible buckets.
Filestash is a unified storage management platform that provides a web-based interface for browsing, managing, and accessing files across diverse local and cloud storage backends. It functions as a centralized gateway, aggregating services such as S3, SFTP, WebDAV, and FTP into a single, consistent environment for remote filesystem administration and secure document handling. The platform distinguishes itself through a modular, plugin-based architecture that supports custom storage drivers, authentication providers, and authorization logic. It includes built-in capabilities for server-side me
Maps diverse storage protocols into a common internal interface to provide a consistent file management experience.
Flysystem is a PHP storage library that provides a filesystem abstraction layer. It enables the management of files across local disks, cloud buckets, and remote servers using a unified interface, decoupling application logic from provider-specific APIs. The project facilitates storage provider migration by allowing developers to swap underlying adapters without changing application code. It includes a multi-backend manager capable of mounting volumes and coordinating file movements between diverse storage systems. The library covers a broad range of file operations, including directory list
Provides a unified interface for managing file operations across diverse storage backends like local disks and cloud buckets.
Redux Persist is a state management utility designed to maintain application data across sessions by synchronizing state with local storage. It functions as a middleware-based engine that automatically saves and restores application state, ensuring that user sessions remain intact after page refreshes or application restarts. The library distinguishes itself through granular control over the persistence lifecycle and data structure. It supports recursive state tree partitioning, allowing developers to apply distinct storage configurations and filtering rules to specific branches of the applic
Provides a unified interface for heterogeneous storage backends to handle data persistence across diverse web and mobile environments.
Docuseal is an open-source digital signature platform designed for self-hosted document management and automated signing workflows. It provides a visual builder for creating fillable PDF forms and tools for orchestrating multi-party signing processes, allowing organizations to maintain full control over their data and infrastructure. The platform distinguishes itself through its focus on integration and extensibility. It offers a programmatic interface for automating document lifecycles and provides embedded components that allow developers to inject signing interfaces directly into their own
Provides a unified interface for persisting files to local disks or cloud-based object storage providers.
Keystone is a GraphQL headless content management system and Node.js backend framework. It functions as a schema-driven data manager that automatically generates a GraphQL API and a React administrative dashboard based on a central data model configuration. The system uses an adapter-based database abstraction to decouple core logic from storage layers and a storage-provider abstraction for managing media assets via local or cloud drivers. It distinguishes itself through a component-based field rendering system and a hook-based middleware pipeline for data validation and automation. The fram
Provides a unified interface for managing media assets across local and cloud storage backends.
This project is a self-hosted cloud storage server and content collaboration platform implemented as a PHP web application framework. It functions as a centralized server for storing, synchronizing, and sharing files and data across multiple devices. The system operates as a WebDAV file server and a synchronization server for scheduling and contact information using CalDAV and CardDAV protocols. It features a plugin architecture that allows the server to be extended with additional applications and custom features. The platform provides capabilities for user and group access management, exte
Implements a unified storage abstraction layer to connect the core system with various third-party storage providers.
CarrierWave is a Ruby file upload library used to manage the uploading, storing, and retrieval of files within web frameworks such as Rails and Sinatra. It functions as an Active Record file manager that associates uploaded assets with database records. The project includes an image processing pipeline for generating thumbnails and derivative versions of uploaded images. It also features a file validation engine to restrict uploads based on allowlists or denylists of extensions and content types, and provides cloud storage integration to manage assets on remote providers. The library covers
Standardises file interactions across different local and remote cloud providers using a common interface.
Loco is a full-stack web framework for Rust designed to accelerate application development using a convention-over-configuration approach. It functions as an MVC web framework that provides a structured environment for building web applications and REST APIs. The project distinguishes itself through an integrated API development toolkit and a command-line scaffolding engine. These tools automate the creation of controllers, models, and migrations, allowing for the rapid generation of functional CRUD resources and application boilerplate. The framework covers a broad range of backend capabili
Provides unified interfaces for managing file operations across local disk and cloud storage providers.
Fine Uploader is a browser file upload widget and manager that provides a frontend interface for transferring multiple files. It functions as a chunked file upload manager and a client-side image processor. The project enables the direct transfer of files to cloud storage providers, specifically Amazon S3 and Microsoft Azure, to reduce the load on application servers. It includes tools for scaling and resizing image dimensions during the upload process to save bandwidth. The system manages large file transfers by splitting them into small pieces, allowing for pause and resume functionality.
Provides a unified interface for managing file operations across diverse storage backends like S3 and Azure.
Feast is an open-source feature store for machine learning that provides a central platform for defining, storing, and serving features across both training and inference workflows. It operates as a declarative system where feature definitions are written as code in Python files, synchronized to a central registry, and made available for low-latency online retrieval or point-in-time correct historical joins for training datasets. The project abstracts storage behind a pluggable architecture, allowing offline and online backends to be swapped without changing retrieval logic, and coordinates ma
Feast provides a single data access layer that decouples feature storage from retrieval, keeping models portable across environments.
KServe is a Kubernetes-native platform for deploying and serving machine learning models as scalable inference services. It supports both generative AI models, including large language models, and traditional predictive models from frameworks such as TensorFlow, PyTorch, Scikit-Learn, XGBoost, and ONNX. The platform manages the full lifecycle of model deployments, including revision tracking, canary rollouts, A/B testing, and automatic rollbacks, and provides serverless scale-to-zero capabilities for cost-efficient resource management. KServe distinguishes itself through a standardized infere
Loads models from cloud storage, Hugging Face, or local volumes through a unified abstraction.
Goravel ist ein voll ausgestattetes Entwicklungs-Scaffold und Framework für die Erstellung von Webanwendungen, REST-APIs und gRPC-Diensten mit der Programmiersprache Go. Es implementiert eine Model-View-Controller-Architektur und bietet ein umfassendes Toolkit für leistungsstarke RPC-Server und -Clients. Das Framework zeichnet sich durch sein umfangreiches integriertes Ökosystem aus, das einen flüssigen Object-Relational-Mapper (ORM) für die Datenbankverwaltung und ein dediziertes CLI-Toolkit für administrative Automatisierung und Projekt-Scaffolding umfasst. Es verfügt über eine treiberbasierte Dienstabstraktion, die es Entwicklern ermöglicht, Speicher-, Cache- und Session-Backends auszutauschen, ohne die Anwendungslogik zu ändern. Die Plattform deckt ein breites Spektrum an Anwendungsfunktionen ab, darunter asynchrone Aufgabenverarbeitung mit verteilten Queues, sicheres Identitätsmanagement mittels tokenbasierter Authentifizierung sowie eine robuste Sicherheitsschicht mit Verschlüsselung und Zugriffskontrolle. Sie bietet zudem Tools für Content-Lokalisierung, Template-Rendering und eine automatisierte Testinfrastruktur mit Dependency-Mocking.
Offers a unified interface for managing file operations across diverse storage backends.
H2 ist ein JDBC-konformes relationales Datenbankmanagementsystem, das in Java geschrieben ist. Es fungiert als einbettbare SQL-Datenbank, die direkt innerhalb eines Anwendungsprozesses ausgeführt werden kann, um Netzwerklatenz zu eliminieren, oder als In-Memory-Datenbank für performante, flüchtige Speicherung. Es enthält zudem eine webbasierte Konsole zur Ausführung von SQL-Befehlen und zur Verwaltung von Schemata. Das System zeichnet sich durch flexible Bereitstellungsmodi aus, einschließlich eines Standalone-Server-Modus für Remote-TCP/IP-Zugriffe und eines gemischten Modus für gleichzeitige lokale und Remote-Konnektivität. Es verfügt über eine Dialekt-Emulationsschicht und Kompatibilitätsmodi, die es ermöglichen, das Verhalten und die Syntax anderer Datenbanksysteme nachzuahmen. Die Engine bietet ein breites Spektrum an Funktionen, darunter ACID-Transaktionen mit Multi-Version Concurrency Control (MVCC), Unterstützung für Geodaten und JSON sowie fortgeschrittene analytische Fensterfunktionen. Es enthält Tools zur Datensicherung durch komprimierte Backups, SQL-Skript-Wiederherstellung und Off-Heap-Speicherverwaltung für große Datensätze. Die Datenbank lässt sich über Standard-JDBC-Treiber und Verbindungs-URLs in Anwendungen integrieren.
Provides a unified interface to manage data across diverse media such as memory, disk, and zip files.
CloudPaste is a secure file sharing platform and multi-backend storage aggregator. It unifies local and S3-compatible cloud storage providers into a single managed file system, serving as a gateway for centralized file access and distribution. The platform distinguishes itself through a built-in browser-based Markdown editor for composing documents with formulas and diagrams. It provides secure content sharing using password protection, expiration dates, and path-restricted API keys to control programmatic access and visibility. The system covers broad capabilities in file management, includ
Implements a unified interface to manage file operations across local disks and S3-compatible storage.