45 Repos
Utilities for synchronizing local file systems with remote cloud storage providers.
Distinguishing note: Focuses on command-line synchronization utilities rather than general storage management.
Explore 45 awesome GitHub repositories matching data & databases · Cloud Storage Sync Tools. Refine with filters or upvote what's useful.
rclone is a command-line utility and sync engine for managing, synchronizing, and migrating files across numerous cloud storage providers. It functions as a storage management tool that enables bidirectional or one-way synchronization between local filesystems and remote cloud backends. The project acts as a unified cloud storage gateway, capable of merging multiple remote providers into a single directory tree. It further provides a filesystem mount to expose remote cloud storage as a local disk for direct operating system access and a transparent encryption wrapper to secure data before it
Synchronizes data between local systems and remote cloud providers to maintain file consistency.
Copyparty is a self-hosted file server that provides a browser-based interface for managing, browsing, uploading, and downloading files. It utilizes a virtual file system abstraction to map diverse storage backends and network-attached devices into a unified directory structure, allowing for consistent file access across various storage environments. The platform functions as a cloud synchronization gateway, enabling automated data backups and transfers between local storage and remote cloud providers through integration with standard command-line tools. It also serves as a distributed storag
Connect local storage to remote cloud providers by configuring the server to act as a backend for standard command-line tools that manage data transfers.
Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep
Synchronizes local project files with cloud storage buckets to facilitate deployment.
SingleFile is a browser-based utility designed to preserve the visual state and functional integrity of web pages by capturing them as self-contained HTML files. It functions by traversing the document object model to embed external assets, such as images, stylesheets, and scripts, directly into a single document for reliable offline viewing. The tool distinguishes itself through its ability to handle complex, dynamic web content by executing custom scripts and managing cross-origin resource requests during the capture process. It utilizes isolated execution environments and shadow document f
Uploads saved archives directly to remote cloud storage providers for centralized access and backup.
This project is a local-first task manager and time tracking tool designed to consolidate work items from multiple external project management platforms into a single, unified interface. By prioritizing local data sovereignty, it ensures that all task lists, time logs, and application states remain on the user's device, providing full functionality in offline environments while maintaining privacy. The application distinguishes itself through a focus on deep work and structured productivity rituals. It integrates distraction-free modes, configurable focus timers, and automated time tracking t
Connects to user-selected storage to synchronize information across devices using encrypted containers.
DVC is a data versioning tool and pipeline orchestrator designed to track large datasets and machine learning models. It functions as a system for managing large data artifacts by storing lightweight metadata in version control while keeping the actual binaries in a separate cache. The project serves as an experiment tracker and remote storage synchronizer, enabling the execution and comparison of machine learning iterations based on hyperparameters and performance metrics. It provides a bridge for pushing and pulling these large data artifacts between local environments and cloud or on-premi
Synchronizes local data caches with cloud platforms or on-premises network storage.
DVC is a data versioning tool and pipeline orchestrator designed to track large datasets and machine learning models using external storage and metadata pointers. It integrates with Git by utilizing placeholders to keep heavy artifacts out of the repository while maintaining a versioned link between code and data. The system manages remote data caches through a synchronization layer that connects local environments to cloud storage or network filesystems. It also functions as an experiment tracker, recording hyperparameters and metrics to compare the performance of different model iterations.
Synchronizes local data caches with remote cloud storage providers using standard transfer protocols.
Hydra is a cross-platform desktop application designed to serve as a centralized game library manager. It consolidates video games from multiple sources and platforms into a single, searchable interface, allowing users to organize their collections and manage installations through a unified dashboard. The application distinguishes itself through extensive support for interface personalization and data portability. Users can modify the visual appearance and notification sounds of the launcher by creating or installing community-shared themes. Furthermore, the tool includes integrated cloud syn
Synchronizes local game save files with external storage providers to maintain progress across devices.
This project is a command-line synchronization client for OneDrive and SharePoint libraries on Linux. It functions as a synchronization engine that aligns local filesystems with cloud storage through bidirectional, unidirectional, or download-only workflows. The client supports headless authentication for servers without web browsers and can be deployed as a background service or within a containerized environment. It enables the management of multiple distinct cloud accounts on a single system and integrates with shared SharePoint sites and document libraries. The synchronization engine inc
Provides a command-line utility to synchronize local filesystems with OneDrive and SharePoint cloud storage.
Note-gen is an artificial intelligence-assisted note-taking application and knowledge management tool designed for local-first data ownership. It functions as a workspace that leverages language models to organize, summarize, and synthesize personal notes into structured documents while maintaining offline accessibility. The platform distinguishes itself through a multimodal workflow orchestrator that chains sequences of tasks to process text, images, and external data. By integrating vision-language models, it extracts information from visual inputs like screenshots and documents, converting
Synchronizes collections of files to remote storage providers like version control systems or cloud storage.
Skill Seekers is a toolset for generating large language model knowledge bases, featuring a multi-source content scraper and a dedicated RAG data pipeline. It extracts technical data from documentation, code, and video to create structured assets and configuration files for AI-powered IDE extensions. The project distinguishes itself through the ability to transform raw data into polished tutorials and specialized skills for AI plugin marketplaces. It utilizes abstract syntax tree parsing and optical character recognition to analyze GitHub repositories, PDFs, and video frames, converting these
Uploads processed knowledge assets directly to object storage providers.
CoAI is an enterprise-grade, self-hostable AI gateway platform that unifies access to over 200 AI models from more than 35 providers through a single OpenAI-compatible API endpoint. It functions as a multi-tenant gateway, routing requests across providers with load balancing, automatic failover, and priority-based routing, while exposing standard OpenAI API endpoints for chat, image generation, model listing, and billing to enable seamless integration with existing tools and clients. The platform distinguishes itself through a comprehensive set of operational capabilities built around the gat
Keeps chat history and settings consistent across multiple clients through cloud storage.
Laverna is an open-source note-taking application designed as a privacy-focused alternative to Evernote. It operates as a single-page application that runs entirely in the browser, combining Markdown editing with client-side encryption to ensure note content is encrypted on the device before it ever reaches a server or cloud storage. The application distinguishes itself through its offline-first architecture, storing notes locally using browser storage for full offline access and editing capabilities. It synchronizes notes across devices through a unified interface that connects to multiple b
Synchronize notes with cloud services like Dropbox and RemoteStorage for backup and cross-device access.
gdrive is a command line interface client for managing files, folders, and permissions within Google Drive. It functions as a backup utility and synchronization tool, allowing users to interact with their cloud storage through a terminal instead of a web browser. The project supports server-to-server integration by using service accounts and JSON credential files. This enables non-interactive identity verification and session establishment without requiring interactive user login prompts. The tool covers bidirectional and one-way synchronization between local directories and remote storage,
Synchronizes local file systems with remote Google Drive storage via a command-line utility.
bypy is a Python client for interacting with Baidu Yun cloud storage via its official API. It functions as both a library for programmatic integration and a command-line manager for organizing and listing files within a cloud account. The project features a multi-process transfer tool that utilizes parallel processing to accelerate high-volume uploads and downloads. It provides bidirectional directory synchronization to align content between local file systems and remote cloud storage by identifying missing or outdated files. The tool covers recursive file transfers, automated cloud data bac
Ships command-line utilities for synchronizing local file systems with remote cloud storage providers.
Dillinger ist ein browserbasierter Markdown-HTML5-Editor, der für Echtzeit-Textbearbeitung und visuelles Rendering entwickelt wurde. Er fungiert als Cloud-synchronisiertes Schreibwerkzeug, das Markup-Syntax in Live-HTML-Vorschauen umwandelt und OAuth-integrierte Authentifizierung nutzt, um Benutzer mit Drittanbieterdiensten zu verbinden. Das Projekt zeichnet sich durch die Integration von Cloud-Dokumentsynchronisierung mit externen Speicheranbietern und das Angebot direkter Veröffentlichungsfunktionen auf Plattformen wie Medium aus. Es enthält zudem einen dedizierten Markdown-zu-PDF-Konverter zum Generieren professioneller Dokumente sowie einen Fokus-Modus, um einen ablenkungsfreien Schreib-Workflow zu schaffen. Der Editor bietet umfassende Inhaltsverwaltung durch Multi-Format-Exportoptionen, lokale Dateiverwaltung mit Drag-and-Drop-Unterstützung und eine anpassbare Benutzeroberfläche. Die Sicherheit wird durch clientseitige HTML-Sanitisierung gehandhabt, um Skript-Injektionen während des Rendering-Prozesses zu verhindern.
Synchronizes local files and documents with remote cloud storage providers.
Floccus is a browser extension that synchronizes bookmarks across different browsers and devices. It runs directly within the browser to access the native bookmark API, and offers both one-way and two-way sync modes to control how changes flow between devices. The extension includes an optional end-to-end encryption layer that encrypts bookmark data client-side before transmission, ensuring only the user can decrypt it on other devices. The extension supports multiple storage backends through a unified sync interface, including WebDAV, Google Drive, and Nextcloud, allowing users to choose bet
Transferring bookmarks between devices using Google Drive or Dropbox as a simple hosted sync option.
Violentmonkey is a userscript manager extension and JavaScript injection framework. It allows users to install and manage custom scripts and CSS to modify the behavior and appearance of websites based on metadata-driven trigger conditions. The project functions as a cloud-synced script manager, backing up and synchronizing scripts across different devices using external cloud storage services. It also serves as a cross-origin request bridge, providing a communication layer that enables scripts to bypass the same-origin policy to fetch data. The tool covers a broad range of browser automation
Backs up and synchronizes user scripts across different devices using external cloud storage providers.
Noms is a distributed version control database and content-addressable data store. It identifies data by cryptographic hashes to ensure integrity and deduplication, while tracking dataset state changes through a sequence of immutable commits to enable branching, forking, and historical recovery. The system functions as a peer-to-peer data synchronizer, reconciling state between disconnected database instances to ensure all nodes converge on the same data. It distinguishes itself as a schema-flexible document store that supports self-describing types, allowing schemas to evolve and widen as ne
Reconciles changes between disconnected database instances to ensure all copies eventually converge on the same state.
gopass is a terminal-based password manager and GPG secret store used for generating, storing, and retrieving encrypted credentials. It functions as a collaborative secret manager that encrypts data using GPG or age and synchronizes it across devices and teams using Git. The system distinguishes itself by treating version control repositories as the primary storage backend, enabling secure secret sharing and version history for credentials. It utilizes a hierarchical directory structure to organize secrets on the filesystem and supports multi-store mounting to combine multiple independent rep
Supports saving encrypted password files on local filesystems that are monitored by cloud storage providers.