12 repository-uri
Middleware that bridges local file systems with remote cloud storage providers for synchronization.
Distinguishing note: Specifically targets the synchronization bridge between local and remote storage, distinct from general database management.
Explore 12 awesome GitHub repositories matching data & databases · Cloud Storage Gateways. Refine with filters or upvote what's useful.
Copyparty is a self-hosted file server that provides a browser-based interface for managing, browsing, uploading, and downloading files. It utilizes a virtual file system abstraction to map diverse storage backends and network-attached devices into a unified directory structure, allowing for consistent file access across various storage environments. The platform functions as a cloud synchronization gateway, enabling automated data backups and transfers between local storage and remote cloud providers through integration with standard command-line tools. It also serves as a distributed storag
A server-side bridge that connects local file systems to remote storage providers for automated data backup and transfer operations.
StackEdit is a browser-based Markdown editor designed for structured document authoring and collaborative content creation. It functions as an offline-first web application, allowing users to maintain full access to their documents and editing tools without an active internet connection, with changes automatically synchronized once connectivity is restored. The platform distinguishes itself through its support for real-time multi-user collaboration, utilizing operational transformation to merge concurrent edits from multiple participants. It features a modular architecture that supports speci
Connects local document workflows to cloud providers for backup, versioning, and cross-device accessibility.
Calibre-web is a self-hosted web application that provides a browser-based interface for browsing, managing, and reading digital book collections stored in a library database. It functions as a comprehensive library management system, allowing users to organize large collections, edit metadata, and perform automated content updates through a centralized administrative dashboard. The platform distinguishes itself by integrating directly with external infrastructure to extend the capabilities of a standard digital library. It supports remote storage mapping to host files on cloud providers, uti
Acts as a bridge between local library databases and remote cloud storage to enable distributed file access.
Mackup is a dotfile backup manager and application settings backup tool designed to keep software configuration files consistent across multiple computers. It functions by copying home directory configuration files into a centralized storage folder for preservation, restoration, and synchronization. The utility utilizes a symbolic link manager to replace local configuration files with symlinks pointing to a synchronized folder, enabling real-time updates. It supports cloud storage integration, allowing these configuration directories to be mirrored to remote backends for cross-machine environ
Supports mirroring configuration directories to remote cloud backends for cross-machine environment setup.
SFTPGo is a multi-protocol file server and secure file transfer gateway that enables the exchange and storage of files via SFTP, FTP, HTTP, and WebDAV. It provides a unified management interface and a web-based file manager for configuring server settings, user permissions, and collaborating on documents. The project functions as a cloud storage gateway, bridging legacy file transfer protocols to modern backends such as S3, Google Cloud Storage, and Azure Blob. It features an automated data workflow engine that uses dynamic logic and virtual folders to route files and manage data lifecycles a
Provides a gateway that bridges legacy file transfer protocols to modern cloud storage backends.
s3fs-fuse este un sistem de fișiere bazat pe FUSE care montează bucket-urile Amazon S3 și stocarea de obiecte compatibilă cu S3 ca directoare locale. Funcționează ca un gateway de stocare în cloud, traducând apelurile standard de sistem de fișiere POSIX în cereri API RESTful pentru a permite accesarea obiectelor la distanță ca și cum ar fi fișiere locale. Proiectul permite maparea magazinelor de obiecte la distanță pe căi locale pe Linux, macOS și FreeBSD. Suportă integrarea cu furnizori terți compatibili cu S3 prin utilizarea de URL-uri de serviciu personalizate și stiluri de cerere specializate. Sistemul include capabilități pentru cache-ul local de date și metadate pentru a reduce latența rețelei și frecvența cererilor API. Accesul este gestionat prin autentificare bazată pe credențiale și semnarea cererilor folosind variabile de mediu sau fișiere de credențiale.
Acts as a gateway bridging local file systems with remote S3-compatible cloud storage.
aliyundrive-webdav is a server-side gateway that translates AliyunDrive cloud storage into a WebDAV interface. It functions as a self-hosted cloud file server that maps remote storage accounts to a local network drive, allowing users to manage files through standard network drive clients. The project distinguishes itself by routing data requests directly between the client and the cloud provider to enable direct media streaming without server-side proxying. It utilizes a terminal-based QR code authentication system to exchange scans for refresh tokens and maintains a secure cloud gateway usin
Creates an encrypted HTTPS bridge to safely access private cloud storage from different devices and networks.
This project provides a standardized project directory structure and boilerplate templates for organizing data analysis and machine learning workflows. It serves as a reproducible analysis framework and workspace boilerplate designed to ensure consistency across data science projects. The template distinguishes between exploratory research in notebooks and reusable, testable logic in modular Python packages. It enforces a convention-based directory hierarchy that treats the analysis pipeline as a directed acyclic graph by separating raw, interim, and processed data. The framework covers a br
Automates the synchronization of datasets between local project directories and cloud storage providers.
xiaoya-alist is a containerized storage suite that aggregates multiple cloud storage providers into a unified listing service. It functions as a cloud storage automation tool and media library manager, providing a centralized system for organizing, sharing, and accessing cloud-stored content. The project distinguishes itself through the automation of cloud maintenance, including the automatic refreshing of authentication tokens and the conversion of bulk sharing links into standardized formats. It further enables media playback by crawling metadata to populate searchable libraries and generat
Periodically synchronizes configuration and data files from remote mirrors to ensure environment consistency.
Violentmonkey is a userscript manager extension and JavaScript injection framework. It allows users to install and manage custom scripts and CSS to modify the behavior and appearance of websites based on metadata-driven trigger conditions. The project functions as a cloud-synced script manager, backing up and synchronizing scripts across different devices using external cloud storage services. It also serves as a cross-origin request bridge, providing a communication layer that enables scripts to bypass the same-origin policy to fetch data. The tool covers a broad range of browser automation
Mirrors local script configurations to remote cloud backends to maintain consistency across environments.
Goofys este un gateway de stocare în cloud compatibil POSIX care prezintă bucket-urile de stocare remote ca directoare locale de sistem. Implementează un sistem de fișiere în user-space care mapează serviciile de stocare S3 și Azure Blob către puncte de montare locale, permițând accesarea obiectelor remote prin operațiuni standard de sistem de fișiere. Proiectul oferă capabilități specifice de montare pentru conturile Amazon S3, Azure Blob Storage și Azure Data Lake. Utilizează o implementare bazată pe FUSE pentru a interfața stocarea de obiecte în cloud cu kernel-ul sistemului de operare. Sistemul include optimizări de performanță, cum ar fi caching-ul local pentru citire, pentru a reduce latența, și preluarea concurentă prin range-requests pentru a optimiza descărcarea obiectelor mari. Acesta simulează structuri ierarhice de foldere prin parsarea prefixelor cheilor de obiect pentru a oferi emulare de directoare.
Acts as a bridge that maps S3-compliant and Azure Blob storage services to local system mount points.
Tusd is a server implementation of the open protocol for resumable file uploads over HTTP. It functions as a gateway that streams incoming data directly to local disk or remote object storage backends, ensuring that large files can be processed without exhausting system memory. The server is designed as a modular package that can be embedded directly into existing applications, allowing developers to integrate file transfer capabilities without requiring external service dependencies. It maintains persistent state for all active transfers, enabling clients to pause and resume uploads from the
Acts as a gateway that streams incoming data directly to local or remote storage backends.