16 dépôts
Standardized interfaces for connecting and managing external object storage backends within applications.
Distinguishing note: Focuses on the integration layer for object storage, distinct from specific driver implementations.
Explore 16 awesome GitHub repositories matching data & databases · Object Storage Integrations. Refine with filters or upvote what's useful.
Alist is a unified cloud storage gateway that aggregates disparate remote storage providers into a single, navigable virtual file system. By acting as a remote file system proxy, it decouples file operations from specific provider implementations, allowing users to browse, download, and manage files across heterogeneous backends through a standardized interface. The platform utilizes a driver-based storage abstraction that translates generic file system operations into provider-specific API calls. This architecture supports a wide range of cloud storage services, S3-compatible object storage,
Connecting S3-compatible storage backends to applications to enable seamless file operations and management through a standardized interface.
Halo is a modular content management platform built on the Java Virtual Machine, designed to power dynamic websites through a flexible, extensible architecture. It provides a centralized administrative interface for publishing digital content and managing media assets, serving as a foundation for diverse web projects ranging from personal blogs to corporate sites. The platform distinguishes itself through a plugin-based architecture that allows for the dynamic loading of functional components and third-party services without modifying the core source code. This extensibility is complemented b
Offloads media and binary assets to remote storage services to maintain a lightweight application state.
Argo Workflows is a container-native workflow engine that functions as a Kubernetes custom resource controller. It orchestrates complex sequences of containerized tasks by executing them as directed acyclic graphs, allowing for dependency management and parallel processing within a cluster. The system extends the native Kubernetes control plane to manage the full lifecycle of automated processes, from initial triggering to final resource cleanup. The platform distinguishes itself through its controller-pattern reconciliation, which continuously monitors workflow states to align them with desi
Facilitates data transfer between process steps and various storage providers including cloud object stores and remote network endpoints.
JuiceFS is a distributed file system designed to mount object storage as a local, POSIX-compliant drive. It functions as a cloud-native persistent storage layer that decouples file metadata from raw data, storing metadata in a transactional database while keeping data blocks in object storage. This architecture enables multiple hosts across different regions to access the same storage simultaneously while maintaining strong consistency. The system distinguishes itself by performing data processing, including compression and encryption, directly on the client side before transmission. By split
Connects distributed computing engines to scalable object storage via high-performance interfaces.
在线云盘、网盘、OneDrive、云存储、私有云、对象存储、h5ai、上传、下载
Connects to Oracle Cloud object storage as a file storage backend using access key credentials.
Blinko is a personal knowledge management system and an LLM-powered knowledge base that enables users to capture and organize thoughts through a bi-directional knowledge graph. It functions as a RAG-enabled note-taking application and a self-hosted Markdown editor, allowing for the creation of permanent documentation and fleeting notes. The project distinguishes itself by integrating retrieval-augmented generation to provide conversational querying and AI-powered analysis of private document libraries. It supports both cloud-based and local AI model integration, enabling users to perform sema
Connects to S3-compatible object storage for scalable storage of multimedia files and documents.
Nhost is an open-source backend as a service that provides a managed PostgreSQL database, authentication, and file storage accessible through a unified GraphQL API. It functions as a backend infrastructure orchestrator, enabling the deployment and management of full-stack environments using containerization and command-line automation. The platform distinguishes itself by automating the transformation of relational database tables into a secure GraphQL API and providing an integrated identity provider that supports passwords, magic links, and OAuth. It also includes a serverless function runt
Provides an S3-compatible interface for binary data storage with integrated metadata for permission checks.
LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
Integrates with S3, GCS, and Azure Blob Storage using URI schemes for data persistence.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Manages large-scale data tables across S3, Azure, and GCS while maintaining transactional guarantees.
This project is a self-hosted recipe manager designed for organizing digital libraries, planning meals, and generating shopping lists. It serves as a central hub for recipe collection management, providing tools to store, categorize, and share recipes within a collaborative kitchen workflow. The system distinguishes itself through an AI-powered importer that extracts structured ingredients and instructions from images, PDFs, and websites. It further integrates with home automation environments as a containerized add-on and supports S3-compatible object storage for managing media files. The s
Integrates S3-compatible cloud storage to host user media files instead of the local filesystem.
Coroot is an observability platform and Kubernetes performance monitor that utilizes eBPF to automatically collect metrics, logs, and traces without requiring manual code instrumentation. It functions as an OpenTelemetry trace analyzer and an LLM observability gateway, exposing system health data to large language models through the Model Context Protocol. The platform differentiates itself by combining automated root cause analysis and AI-driven diagnostics to investigate performance regressions. It also includes a cloud cost monitoring tool that attributes infrastructure spending to specifi
Integrates with S3-compatible object storage to scale the retention of logs and metrics.
Backrest is a web-based management interface for Restic that orchestrates scheduled snapshots, manages offsite repositories, and provides a browser for file restoration. It serves as a scheduled backup orchestrator and remote storage manager to maintain data repositories across various backends. The system distinguishes itself through a backup lifecycle automation framework that triggers shell scripts and external notifications based on backup events. It includes a snapshot restoration browser that allows for exploring point-in-time snapshots to recover specific directories to local paths. T
Integrates with remote cloud backends using standardized storage protocols for offsite data protection.
Ce projet est une architecture d'entreprise complète pour construire des systèmes distribués multi-locataires, implémentée en tant que plateforme de microservices Spring Cloud. Il fournit un framework complet pour gérer les microservices, en se concentrant sur l'architecture de données multi-locataires et la fourniture d'identité centralisée. La plateforme se distingue par son approche intégrée de l'identité et de la sécurité, utilisant un fournisseur d'identité OAuth2 pour gérer l'authentification unique (SSO), le contrôle d'accès basé sur les rôles et l'émission de jetons JWT à travers les services distribués. Elle sépare en outre les frontières organisationnelles via l'isolation des données multi-locataires, garantissant que les ressources et les données sont logiquement ou physiquement partitionnées entre différents locataires. Le système couvre une large surface de capacités distribuées, notamment la gouvernance des services via le routage par passerelle API et le circuit breaking, et la coordination des données via des transactions distribuées et des mécanismes de verrouillage. Il inclut également une pile d'observabilité distribuée pour le traçage des requêtes et la journalisation centralisée, ainsi qu'une synchronisation de moteur de recherche en temps réel et une messagerie asynchrone pilotée par événements. Le flux de travail de développement est pris en charge par des outils d'automatisation pour la génération de code d'application et l'empaquetage de binaires spécifiques à la plateforme.
Provides standardized interfaces for integrating and managing external cloud object storage backends.
Util est un framework de développement complet pour .NET conçu pour implémenter des architectures en couches et le domain-driven design. Il fournit une boîte à outils de classes de base et d'outils pour construire des applications full stack, se concentrant spécifiquement sur la création de frameworks d'administration backend et d'interfaces de gestion. Le projet se distingue par un générateur de boilerplate qui produit les types et classes nécessaires pour standardiser les patterns architecturaux répétitifs. Il inclut également un orchestrateur de micro-frontend qui permet de diviser les grands modules frontend en projets indépendants pour un développement et un déploiement séparés. Le framework couvre un large éventail de domaines de capacité, incluant la gestion des identités et des accès avec contrôle basé sur les rôles, l'isolation des données multi-tenant et l'enregistrement automatique des dépendances. Il fournit en outre des utilitaires pour l'audit des changements de données, la localisation de contenu, l'intégration de stockage d'objets et la génération d'interfaces CRUD. Le système prend en charge la création d'interfaces d'administration en utilisant des composants UI pré-intégrés et le rendu côté serveur via Razor TagHelpers.
Integrates standardized interfaces for managing file uploads and downloads via cloud object storage buckets.
Lilishop is a multi-vendor B2B2C e-commerce platform designed as a marketplace where third-party merchants can manage independent storefronts within a unified ecosystem. It is built on a Spring Cloud microservices architecture and a Spring Boot backend, utilizing Vue and Uniapp to deliver responsive user interfaces across web, mobile, and mini-program platforms. The platform differentiates itself through integrated marketing automation tools, including group buying, bargain campaigns, and a commission-based affiliate distribution network. It also features a comprehensive financial settlement
Implements standardized interfaces to connect the system to external cloud object storage backends.
SyncClipboard is a cross-platform synchronization service and server designed to share clipboard content and history across multiple devices. It utilizes a central server and a REST-based API to facilitate the exchange of data between custom client implementations. The system features a self-hosted synchronization server and a command-line interface for controlling clipboard data and executing application commands via the terminal. It includes an image format converter that downloads original source files and transforms modern image formats into compatible types to ensure successful pasting a
Supports linking WebDAV or S3 compatible object storage to store and synchronize clipboard data.