20 रिपॉजिटरी
Mechanisms for replicating database state to third-party cloud storage providers.
Distinct from Edge-to-Cloud Synchronization: Distinct from Edge-to-Cloud Synchronization: focuses on specific cloud provider integration rather than general edge-to-cloud replication.
Explore 20 awesome GitHub repositories matching data & databases · Cloud Storage Replication. Refine with filters or upvote what's useful.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Replicates local database state to cloud storage folders to enable cross-device synchronization.
KeyDB is a multithreaded in-memory key-value store and distributed cache. It functions as a NoSQL database utilizing multi-version concurrency control to execute non-blocking queries and scans. The project is a multithreaded fork of Redis that maintains protocol compatibility while utilizing a multithreaded architecture to scale across multi-core hardware. It distinguishes itself with flash-tiered storage, allowing the system to offload data from primary RAM to SSD or flash storage to increase total capacity. The system supports high availability through active-active mesh replication and mu
Provides a mechanism to dump and load database snapshots directly to and from remote cloud storage buckets.
Velero is a backup and recovery tool for Kubernetes cluster resources and persistent volumes. It functions as a disaster recovery solution and a utility for migrating applications and their associated data between different clusters. The project enables the replication of production environments by cloning cluster resources into development or testing environments for validation and debugging. It provides capabilities for backing up system objects, restoring resources to a known good state, and transferring applications across environments to facilitate system transitions.
Saves Kubernetes resource manifests and volume snapshots as serialized files in remote cloud object storage buckets.
immudb is a tamperproof database that maintains an immutable record of entries using cryptographic commit logging. It ensures verifiable database integrity by utilizing Merkle trees to generate membership and consistency proofs that detect unauthorized data alterations. The system employs a multi-model storage engine that unifies key-value, document, and relational data structures within a single immutable backend. It provides compatibility with the PostgreSQL wire protocol, allowing it to integrate with standard SQL clients, ORMs, and database tools. The project covers broad capabilities in
Replicates database state to third-party cloud storage providers to enable remote storage for ephemeral deployments.
Noms is a distributed version control database and content-addressable data store. It identifies data by cryptographic hashes to ensure integrity and deduplication, while tracking dataset state changes through a sequence of immutable commits to enable branching, forking, and historical recovery. The system functions as a peer-to-peer data synchronizer, reconciling state between disconnected database instances to ensure all nodes converge on the same data. It distinguishes itself as a schema-flexible document store that supports self-describing types, allowing schemas to evolve and widen as ne
Exports database snapshots to remote cloud object storage buckets for recovery and durability.
Dropbox-Uploader is a Bash-based command-line client for managing files on Dropbox. It provides a full set of file operations including upload, download, copy, move, rename, delete, directory creation, and listing, all through shell scripts that use curl to interact with the Dropbox API. The tool authenticates via OAuth tokens and includes a chunked upload mechanism for handling large files reliably. The project distinguishes itself with an interactive shell interface that lets users browse and manage remote files without re-entering commands, and a file-name-based password derivation system
Compresses a local directory into an encrypted archive and uploads it to a remote cloud storage service.
ZeroByte is a backup management platform built around the Restic backup engine, providing encrypted, deduplicated, and compressed snapshots across multiple storage backends. It offers a web interface for scheduling, monitoring, and managing backup operations, with support for cron-based job scheduling and configurable retention policies that automatically prune older snapshots. The platform distinguishes itself through comprehensive multi-protocol volume mounting, allowing backup ingestion from NFS, SMB, WebDAV, SFTP, and rclone-backed sources alongside local directories. It includes a snapsh
Supports backing up to S3, Google Cloud Storage, Azure Blob, and 40+ rclone backends for remote storage.
Exports and saves note data automatically to cloud storage services like Dropbox or Google Drive.
Android-DataBackup is a rooted Android backup tool that backs up and restores complete application data on devices using Magisk, KernelSU, or APatch. It operates as a root-based backup manager, executing commands through a root shell to bypass Android's sandboxing and access app-specific data directories directly. The tool integrates with Magisk, KernelSU, and APatch to gain root-level access for reading and writing protected application data directories. It compresses backup data into tar archives to preserve file permissions, ownership, and directory structure for reliable restoration, whil
Uploads backup archives to a cloud service for off-device storage and later retrieval.
Duplicacy is a cross-platform, deduplicated backup tool that stores encrypted snapshots to local disks and cloud storage services. It operates through both a command-line executable and a web-based graphical interface, enabling backup, restore, and repository management in scripts or through a browser. The software splits files into variable-size chunks identified by their hash, enabling cross-machine deduplication without a central database or chunk index. Each backup creates an immutable snapshot that stores file metadata and chunk references, supporting incremental updates and point-in-tim
Stores backup data on local disks, SFTP servers, and most cloud storage services without sacrificing essential backup features.
AliSQL is a fork of MySQL by Alibaba that extends the relational database management system with enhancements for high performance, scalability, and enterprise-grade availability. It retains the core MySQL identity as a SQL-based database for storing, organizing, and retrieving structured data, while adding optimizations for large-scale transactional and analytical workloads. The project differentiates itself through a set of Alibaba-specific improvements, including a columnar engine for accelerating analytical queries directly on MySQL tables, and a distributed, shared-nothing NDB Cluster en
MySQL writes a backup directly to a cloud storage bucket (OCI, S3, GCP, OpenStack) for off-site retention.
This project is a PostgreSQL Kubernetes operator and database orchestrator designed to automate the deployment, scaling, and lifecycle management of high-availability database clusters. It functions as a controller that uses declarative manifests to provision and synchronize the state of database instances within a cluster. The system manages high availability through streaming replication and ensures constant availability during maintenance via rolling updates. It also serves as a backup and recovery manager, handling point-in-time recovery, logical backups, and cluster cloning using cloud s
Offloads database snapshots and write-ahead logs to cloud object storage for point-in-time recovery.
BaoTa is a web-based Linux server control panel and system administration dashboard designed for managing hosting environments and system resources. It provides a graphical interface to translate administrative actions into system-level configurations, allowing users to manage Linux servers and web hosting stacks without relying solely on the command line. The platform distinguishes itself through AI-driven server operations, utilizing artificial intelligence for performance analysis and the execution of maintenance tasks via natural language commands. It supports multi-node orchestration, en
Schedules automatic backups of websites and databases to third-party object storage or cloud drives.
This project is a Kubernetes operator designed for deploying and managing production PostgreSQL database clusters using declarative configurations. It functions as a controller that synchronizes the actual state of database clusters with a desired state, providing a system for high availability orchestration, automated backup and recovery, and containerized database administration. The operator distinguishes itself through a comprehensive data protection suite that supports point-in-time recovery, multi-mode backups to cloud object storage, and cluster cloning. It ensures continuous availabil
Streams full and incremental backups and write-ahead logs to cloud object storage for disaster recovery and point-in-time restoration.
This project is a Telegram cloud mirror bot designed to download files from various internet sources and mirror them to Telegram or cloud storage. It functions as a specialized service for remote media downloading, torrent and Usenet leeching, and automated content mirroring. The bot distinguishes itself through deep integration with the Rclone ecosystem for managing, cloning, and migrating files across multiple cloud providers. It includes an RSS content automator to trigger downloads based on user-defined filters and utilizes service account rotation to bypass API quotas when managing cloud
Enables the copying of entire folders and files between different cloud storage accounts on the server side.
Valet iOS और macOS में Apple सिस्टम कीचेन में सुरक्षित डेटा स्टोरेज को मैनेज करने के लिए एक Swift लाइब्रेरी है। यह हार्डवेयर-समर्थित सुरक्षित एन्क्लेव का उपयोग करके संवेदनशील स्ट्रिंग्स और डेटा ऑब्जेक्ट्स को स्टोर और पुनर्प्राप्त करने के लिए एक उच्च-स्तरीय रैपर प्रदान करता है। यह प्रोजेक्ट क्लाउड-आधारित कीचेन सेवाओं के माध्यम से कई उपकरणों में संग्रहीत कीचेन डेटा के सिंक्रोनाइज़ेशन को सक्षम बनाता है। इसमें साझा कीचेन एक्सेस और ऐप ग्रुप एंटाइटेलमेंट का उपयोग करके एक ही डेवलपर के कई एप्लिकेशन के बीच सुरक्षित क्रेडेंशियल्स का आदान-प्रदान करने के लिए तंत्र भी शामिल हैं। यह लाइब्रेरी डेटा पुनर्प्राप्ति की सुरक्षा के लिए बायोमेट्रिक प्रमाणीकरण को कवर करती है और मौजूदा कीचेन प्रविष्टियों के माइग्रेशन और रीमैपिंग को मैनेज करती है।
Uses system-level synchronization flags to propagate secure entries across devices via a cloud-based keychain service.
WAL-G एक डेटाबेस क्लाउड बैकअप टूल और राइट-अहेड लॉग आर्काइवर है, जिसे डिजास्टर रिकवरी और पॉइंट-इन-टाइम रिकवरी के लिए डिज़ाइन किया गया है। यह डेटा की दीर्घकालिक सुरक्षा सुनिश्चित करने के लिए डेटाबेस स्टेट और ट्रांजेक्शन लॉग को क्लाउड स्टोरेज प्रोवाइडर्स में आर्काइव करता है। यह प्रोजेक्ट क्लाउड ऑब्जेक्ट स्टोरेज में संग्रहीत डेटाबेस बैकअप को कंप्रेस, एन्क्रिप्ट और प्रून (prune) करने के लिए एक मैनेजर प्रदान करता है। यह विशेष रूप से बेस बैकअप को फेच करके और ट्रांजेक्शन लॉग को रीप्ले करके डेटाबेस को एक विशिष्ट टाइमस्टैम्प पर रिस्टोर करने में सक्षम बनाता है। इस टूल की क्षमताओं में मल्टी-इंजन बैकअप और रिस्टोरेशन शामिल है, जिसमें फुल और डेल्टा बैकअप का निर्माण भी शामिल है। यह इन्वेंट्री ट्रैकिंग और स्वचालित प्रूनिंग नीतियों के माध्यम से बैकअप लाइफसाइकिल का प्रबंधन करता है, और इसमें लॉग आर्काइव और टेबल फाइलों की अखंडता को सत्यापित करने के लिए यूटिलिटीज शामिल हैं। बैकअप और रिस्टोर ऑपरेशंस के परीक्षण के लिए क्लाउड स्टोरेज API को एमुलेट करने हेतु एक लोकल प्रॉक्सी भी उपलब्ध है।
Archives database files and transaction logs to cloud storage providers to ensure long-term data durability.
The etcd-operator is a custom resource controller designed to automate the deployment, scaling, backup, and recovery of distributed key-value storage clusters on container orchestration platforms. By extending container orchestration APIs with custom resource definitions, the system manages multi-node database instances through declarative configuration files and a continuous controller reconciliation loop that drives cluster provisioning, scaling, and maintenance. The operator provides automated cluster member recovery, detecting unresponsive nodes and executing membership replacements to pr
Persists point-in-time state snapshot backups to external object storage for disaster recovery.
Editable Website is a content management system built with Svelte that enables direct inline editing of static web pages without needing a database. It functions as a Git-backed web content editor and a component-based static site builder, storing all website text, configuration, and files in local Git repositories to ensure full data ownership and local version control. The platform supports in-browser content management, allowing users to modify text, format styles, and compose structured page layouts using interactive blocks, drag-and-drop interactions, and keyboard shortcuts. Additional
Replicates database changes and mirrors uploaded assets to an S3-compatible bucket on every write operation.
Container-db-backup is a container-native utility designed to automate database maintenance, including recurring backups, data restoration, and secure archiving. It operates by executing isolated backup jobs within ephemeral containers, ensuring consistent environments for data protection workflows across multiple database hosts. The tool distinguishes itself through a pipeline-oriented processing model that streams database dumps through compression and encryption stages before storage. It supports flexible storage configurations, allowing data to be directed to local filesystems or remote S
Uploads backup files to remote object storage using secure connections for off-site redundancy.