16 repositorios
Standardized interfaces for connecting and managing external object storage backends within applications.
Distinguishing note: Focuses on the integration layer for object storage, distinct from specific driver implementations.
Explore 16 awesome GitHub repositories matching data & databases · Object Storage Integrations. Refine with filters or upvote what's useful.
Alist is a unified cloud storage gateway that aggregates disparate remote storage providers into a single, navigable virtual file system. By acting as a remote file system proxy, it decouples file operations from specific provider implementations, allowing users to browse, download, and manage files across heterogeneous backends through a standardized interface. The platform utilizes a driver-based storage abstraction that translates generic file system operations into provider-specific API calls. This architecture supports a wide range of cloud storage services, S3-compatible object storage,
Connecting S3-compatible storage backends to applications to enable seamless file operations and management through a standardized interface.
Halo is a modular content management platform built on the Java Virtual Machine, designed to power dynamic websites through a flexible, extensible architecture. It provides a centralized administrative interface for publishing digital content and managing media assets, serving as a foundation for diverse web projects ranging from personal blogs to corporate sites. The platform distinguishes itself through a plugin-based architecture that allows for the dynamic loading of functional components and third-party services without modifying the core source code. This extensibility is complemented b
Offloads media and binary assets to remote storage services to maintain a lightweight application state.
Argo Workflows is a container-native workflow engine that functions as a Kubernetes custom resource controller. It orchestrates complex sequences of containerized tasks by executing them as directed acyclic graphs, allowing for dependency management and parallel processing within a cluster. The system extends the native Kubernetes control plane to manage the full lifecycle of automated processes, from initial triggering to final resource cleanup. The platform distinguishes itself through its controller-pattern reconciliation, which continuously monitors workflow states to align them with desi
Facilitates data transfer between process steps and various storage providers including cloud object stores and remote network endpoints.
JuiceFS is a distributed file system designed to mount object storage as a local, POSIX-compliant drive. It functions as a cloud-native persistent storage layer that decouples file metadata from raw data, storing metadata in a transactional database while keeping data blocks in object storage. This architecture enables multiple hosts across different regions to access the same storage simultaneously while maintaining strong consistency. The system distinguishes itself by performing data processing, including compression and encryption, directly on the client side before transmission. By split
Connects distributed computing engines to scalable object storage via high-performance interfaces.
在线云盘、网盘、OneDrive、云存储、私有云、对象存储、h5ai、上传、下载
Connects to Oracle Cloud object storage as a file storage backend using access key credentials.
Blinko is a personal knowledge management system and an LLM-powered knowledge base that enables users to capture and organize thoughts through a bi-directional knowledge graph. It functions as a RAG-enabled note-taking application and a self-hosted Markdown editor, allowing for the creation of permanent documentation and fleeting notes. The project distinguishes itself by integrating retrieval-augmented generation to provide conversational querying and AI-powered analysis of private document libraries. It supports both cloud-based and local AI model integration, enabling users to perform sema
Connects to S3-compatible object storage for scalable storage of multimedia files and documents.
Nhost is an open-source backend as a service that provides a managed PostgreSQL database, authentication, and file storage accessible through a unified GraphQL API. It functions as a backend infrastructure orchestrator, enabling the deployment and management of full-stack environments using containerization and command-line automation. The platform distinguishes itself by automating the transformation of relational database tables into a secure GraphQL API and providing an integrated identity provider that supports passwords, magic links, and OAuth. It also includes a serverless function runt
Provides an S3-compatible interface for binary data storage with integrated metadata for permission checks.
LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
Integrates with S3, GCS, and Azure Blob Storage using URI schemes for data persistence.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Manages large-scale data tables across S3, Azure, and GCS while maintaining transactional guarantees.
This project is a self-hosted recipe manager designed for organizing digital libraries, planning meals, and generating shopping lists. It serves as a central hub for recipe collection management, providing tools to store, categorize, and share recipes within a collaborative kitchen workflow. The system distinguishes itself through an AI-powered importer that extracts structured ingredients and instructions from images, PDFs, and websites. It further integrates with home automation environments as a containerized add-on and supports S3-compatible object storage for managing media files. The s
Integrates S3-compatible cloud storage to host user media files instead of the local filesystem.
Coroot is an observability platform and Kubernetes performance monitor that utilizes eBPF to automatically collect metrics, logs, and traces without requiring manual code instrumentation. It functions as an OpenTelemetry trace analyzer and an LLM observability gateway, exposing system health data to large language models through the Model Context Protocol. The platform differentiates itself by combining automated root cause analysis and AI-driven diagnostics to investigate performance regressions. It also includes a cloud cost monitoring tool that attributes infrastructure spending to specifi
Integrates with S3-compatible object storage to scale the retention of logs and metrics.
Backrest is a web-based management interface for Restic that orchestrates scheduled snapshots, manages offsite repositories, and provides a browser for file restoration. It serves as a scheduled backup orchestrator and remote storage manager to maintain data repositories across various backends. The system distinguishes itself through a backup lifecycle automation framework that triggers shell scripts and external notifications based on backup events. It includes a snapshot restoration browser that allows for exploring point-in-time snapshots to recover specific directories to local paths. T
Integrates with remote cloud backends using standardized storage protocols for offsite data protection.
Este proyecto es una arquitectura empresarial integral para construir sistemas distribuidos multi-inquilino, implementada como una plataforma de microservicios de Spring Cloud. Proporciona un framework completo para gestionar microservicios, centrándose en la arquitectura de datos multi-inquilino y la provisión centralizada de identidad. La plataforma se distingue por su enfoque integrado de identidad y seguridad, utilizando un proveedor de identidad OAuth2 para gestionar el inicio de sesión único, control de acceso basado en roles y emisión de tokens JWT a través de servicios distribuidos. Además, separa los límites organizacionales mediante el aislamiento de datos multi-inquilino, asegurando que los recursos y datos estén lógica o físicamente particionados entre diferentes inquilinos. El sistema cubre una amplia superficie de capacidades distribuidas, incluyendo la gobernanza de servicios mediante enrutamiento de API gateway y disyuntores, y la coordinación de datos mediante transacciones distribuidas y mecanismos de bloqueo. También incluye una pila de observabilidad distribuida para el trazado de solicitudes y registro centralizado, junto con la sincronización de motores de búsqueda en tiempo real y mensajería asíncrona basada en eventos. El flujo de trabajo de desarrollo es compatible con herramientas de automatización para la generación de código de aplicación y empaquetado de binarios específico de la plataforma.
Provides standardized interfaces for integrating and managing external cloud object storage backends.
Util is a comprehensive development framework for .NET designed to implement layered architectures and domain driven design. It provides a toolkit of base classes and tools for building full stack applications, specifically focusing on the creation of backend admin frameworks and management interfaces. The project distinguishes itself through a boilerplate generator that produces the necessary types and classes to standardize repetitive architectural patterns. It also includes a micro-frontend orchestrator that enables the splitting of large frontend modules into independent projects for sepa
Integrates standardized interfaces for managing file uploads and downloads via cloud object storage buckets.
Lilishop es una plataforma de comercio electrónico B2B2C multi-vendedor diseñada como un mercado donde comerciantes externos pueden gestionar escaparates independientes dentro de un ecosistema unificado. Está construida sobre una arquitectura de microservicios Spring Cloud y un backend Spring Boot, utilizando Vue y Uniapp para ofrecer interfaces de usuario responsivas en plataformas web, móviles y de mini-programas. La plataforma se diferencia por sus herramientas integradas de automatización de marketing, incluyendo compras grupales, campañas de ofertas y una red de distribución de afiliados basada en comisiones. También cuenta con un sistema integral de liquidación financiera que maneja el procesamiento de pagos multicanal a través de Alipay y WeChat Pay, junto con la distribución automatizada de comisiones y la facturación a comerciantes. El sistema cubre una amplia gama de operaciones minoristas, incluyendo gestión jerárquica de catálogos, distribución automatizada de cupones y seguimiento del ciclo de vida de pedidos omnicanal. Incluye herramientas dedicadas para arbitraje de disputas, auditoría de servicios postventa e indexación de búsqueda de productos facetada. El despliegue se gestiona a través de scripts de Docker y Compose para facilitar la orquestación de sus servicios de API distribuidos y consumidores.
Implements standardized interfaces to connect the system to external cloud object storage backends.
SyncClipboard is a cross-platform synchronization service and server designed to share clipboard content and history across multiple devices. It utilizes a central server and a REST-based API to facilitate the exchange of data between custom client implementations. The system features a self-hosted synchronization server and a command-line interface for controlling clipboard data and executing application commands via the terminal. It includes an image format converter that downloads original source files and transforms modern image formats into compatible types to ensure successful pasting a
Supports linking WebDAV or S3 compatible object storage to store and synchronize clipboard data.