16 Repos
Standardized interfaces for connecting and managing external object storage backends within applications.
Distinguishing note: Focuses on the integration layer for object storage, distinct from specific driver implementations.
Explore 16 awesome GitHub repositories matching data & databases · Object Storage Integrations. Refine with filters or upvote what's useful.
Alist is a unified cloud storage gateway that aggregates disparate remote storage providers into a single, navigable virtual file system. By acting as a remote file system proxy, it decouples file operations from specific provider implementations, allowing users to browse, download, and manage files across heterogeneous backends through a standardized interface. The platform utilizes a driver-based storage abstraction that translates generic file system operations into provider-specific API calls. This architecture supports a wide range of cloud storage services, S3-compatible object storage,
Connecting S3-compatible storage backends to applications to enable seamless file operations and management through a standardized interface.
Halo is a modular content management platform built on the Java Virtual Machine, designed to power dynamic websites through a flexible, extensible architecture. It provides a centralized administrative interface for publishing digital content and managing media assets, serving as a foundation for diverse web projects ranging from personal blogs to corporate sites. The platform distinguishes itself through a plugin-based architecture that allows for the dynamic loading of functional components and third-party services without modifying the core source code. This extensibility is complemented b
Offloads media and binary assets to remote storage services to maintain a lightweight application state.
Argo Workflows is a container-native workflow engine that functions as a Kubernetes custom resource controller. It orchestrates complex sequences of containerized tasks by executing them as directed acyclic graphs, allowing for dependency management and parallel processing within a cluster. The system extends the native Kubernetes control plane to manage the full lifecycle of automated processes, from initial triggering to final resource cleanup. The platform distinguishes itself through its controller-pattern reconciliation, which continuously monitors workflow states to align them with desi
Facilitates data transfer between process steps and various storage providers including cloud object stores and remote network endpoints.
JuiceFS is a distributed file system designed to mount object storage as a local, POSIX-compliant drive. It functions as a cloud-native persistent storage layer that decouples file metadata from raw data, storing metadata in a transactional database while keeping data blocks in object storage. This architecture enables multiple hosts across different regions to access the same storage simultaneously while maintaining strong consistency. The system distinguishes itself by performing data processing, including compression and encryption, directly on the client side before transmission. By split
Connects distributed computing engines to scalable object storage via high-performance interfaces.
在线云盘、网盘、OneDrive、云存储、私有云、对象存储、h5ai、上传、下载
Connects to Oracle Cloud object storage as a file storage backend using access key credentials.
Blinko is a personal knowledge management system and an LLM-powered knowledge base that enables users to capture and organize thoughts through a bi-directional knowledge graph. It functions as a RAG-enabled note-taking application and a self-hosted Markdown editor, allowing for the creation of permanent documentation and fleeting notes. The project distinguishes itself by integrating retrieval-augmented generation to provide conversational querying and AI-powered analysis of private document libraries. It supports both cloud-based and local AI model integration, enabling users to perform sema
Connects to S3-compatible object storage for scalable storage of multimedia files and documents.
Nhost is an open-source backend as a service that provides a managed PostgreSQL database, authentication, and file storage accessible through a unified GraphQL API. It functions as a backend infrastructure orchestrator, enabling the deployment and management of full-stack environments using containerization and command-line automation. The platform distinguishes itself by automating the transformation of relational database tables into a secure GraphQL API and providing an integrated identity provider that supports passwords, magic links, and OAuth. It also includes a serverless function runt
Provides an S3-compatible interface for binary data storage with integrated metadata for permission checks.
LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
Integrates with S3, GCS, and Azure Blob Storage using URI schemes for data persistence.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Manages large-scale data tables across S3, Azure, and GCS while maintaining transactional guarantees.
This project is a self-hosted recipe manager designed for organizing digital libraries, planning meals, and generating shopping lists. It serves as a central hub for recipe collection management, providing tools to store, categorize, and share recipes within a collaborative kitchen workflow. The system distinguishes itself through an AI-powered importer that extracts structured ingredients and instructions from images, PDFs, and websites. It further integrates with home automation environments as a containerized add-on and supports S3-compatible object storage for managing media files. The s
Integrates S3-compatible cloud storage to host user media files instead of the local filesystem.
Coroot is an observability platform and Kubernetes performance monitor that utilizes eBPF to automatically collect metrics, logs, and traces without requiring manual code instrumentation. It functions as an OpenTelemetry trace analyzer and an LLM observability gateway, exposing system health data to large language models through the Model Context Protocol. The platform differentiates itself by combining automated root cause analysis and AI-driven diagnostics to investigate performance regressions. It also includes a cloud cost monitoring tool that attributes infrastructure spending to specifi
Integrates with S3-compatible object storage to scale the retention of logs and metrics.
Backrest is a web-based management interface for Restic that orchestrates scheduled snapshots, manages offsite repositories, and provides a browser for file restoration. It serves as a scheduled backup orchestrator and remote storage manager to maintain data repositories across various backends. The system distinguishes itself through a backup lifecycle automation framework that triggers shell scripts and external notifications based on backup events. It includes a snapshot restoration browser that allows for exploring point-in-time snapshots to recover specific directories to local paths. T
Integrates with remote cloud backends using standardized storage protocols for offsite data protection.
Dieses Projekt ist eine umfassende Enterprise-Architektur für den Aufbau von mandantenfähigen (multi-tenant) verteilten Systemen, implementiert als Spring-Cloud-Microservices-Plattform. Es bietet ein vollständiges Framework für die Verwaltung von Microservices mit Fokus auf mandantenfähige Datenarchitektur und zentralisierte Identitätsbereitstellung. Die Plattform zeichnet sich durch ihren integrierten Ansatz für Identität und Sicherheit aus und nutzt einen OAuth2-Identitätsanbieter, um Single-Sign-On, rollenbasierte Zugriffskontrolle und JWT-Token-Ausstellung über verteilte Dienste hinweg zu verwalten. Sie trennt zudem organisatorische Grenzen durch mandantenfähige Datenisolierung und stellt sicher, dass Ressourcen und Daten logisch oder physisch zwischen verschiedenen Mandanten partitioniert sind. Das System deckt ein breites Spektrum an verteilten Funktionen ab, einschließlich Service-Governance durch API-Gateway-Routing und Circuit-Breaking sowie Datenkoordination mittels verteilter Transaktionen und Sperrmechanismen. Es enthält zudem einen verteilten Observability-Stack für Request-Tracing und zentralisiertes Logging, neben der Synchronisierung von Suchmaschinen in Echtzeit und asynchronem, eventgesteuertem Messaging. Der Entwicklungsworkflow wird durch Automatisierungstools für die Generierung von Anwendungscode und plattformspezifisches Binär-Packaging unterstützt.
Provides standardized interfaces for integrating and managing external cloud object storage backends.
Util ist ein umfassendes Entwicklungsframework für .NET, das darauf ausgelegt ist, geschichtete Architekturen und Domain-Driven-Design zu implementieren. Es bietet ein Toolkit aus Basisklassen und Tools für den Aufbau von Full-Stack-Anwendungen, wobei der Fokus insbesondere auf der Erstellung von Backend-Admin-Frameworks und Verwaltungsoberflächen liegt. Das Projekt zeichnet sich durch einen Boilerplate-Generator aus, der die notwendigen Typen und Klassen produziert, um repetitive Architekturmuster zu standardisieren. Es enthält zudem einen Micro-Frontend-Orchestrator, der die Aufteilung großer Frontend-Module in unabhängige Projekte für separate Entwicklung und Bereitstellung ermöglicht. Das Framework deckt eine breite Palette an Funktionsbereichen ab, einschließlich Identitäts- und Zugriffsmanagement mit rollenbasierter Steuerung, Multi-Tenant-Datenisolierung und automatisierter Abhängigkeitsregistrierung. Es bietet zudem Utilities für Datenänderungsaudits, Inhaltslokalisierung, Objektspeicherintegration und die Generierung von CRUD-Schnittstellen. Das System unterstützt die Erstellung von Admin-Oberflächen mittels vorintegrierter UI-Komponenten und serverseitigem Rendering via Razor-TagHelpers.
Integrates standardized interfaces for managing file uploads and downloads via cloud object storage buckets.
Lilishop ist eine Multi-Vendor-B2B2C-E-Commerce-Plattform, die als Marktplatz konzipiert ist, auf dem Drittanbieter unabhängige Storefronts innerhalb eines einheitlichen Ökosystems verwalten können. Sie basiert auf einer Spring-Cloud-Microservices-Architektur und einem Spring-Boot-Backend und nutzt Vue und Uniapp, um responsive Benutzeroberflächen über Web-, Mobil- und Mini-Programm-Plattformen hinweg bereitzustellen. Die Plattform differenziert sich durch integrierte Marketing-Automatisierungstools, einschließlich Gruppenkäufen, Schnäppchenkampagnen und einem provisionsbasierten Affiliate-Vertriebsnetzwerk. Sie verfügt zudem über ein umfassendes Finanzabrechnungssystem, das die kanalübergreifende Zahlungsabwicklung via Alipay und WeChat Pay sowie die automatisierte Provisionsverteilung und Händlerabrechnung abwickelt. Das System deckt ein breites Spektrum an Einzelhandelsoperationen ab, einschließlich hierarchischer Katalogverwaltung, automatisierter Coupon-Verteilung und kanalübergreifender Verfolgung des Bestelllebenszyklus. Es enthält dedizierte Tools für Streitbeilegung, After-Sales-Service-Audits und facettierte Produktsuchindizierung. Die Bereitstellung wird über Docker- und Compose-Skripte verwaltet, um die Orchestrierung ihrer verteilten API-Dienste und Consumer zu erleichtern.
Implements standardized interfaces to connect the system to external cloud object storage backends.
SyncClipboard is a cross-platform synchronization service and server designed to share clipboard content and history across multiple devices. It utilizes a central server and a REST-based API to facilitate the exchange of data between custom client implementations. The system features a self-hosted synchronization server and a command-line interface for controlling clipboard data and executing application commands via the terminal. It includes an image format converter that downloads original source files and transforms modern image formats into compatible types to ensure successful pasting a
Supports linking WebDAV or S3 compatible object storage to store and synchronize clipboard data.