20 个仓库
Mechanisms for replicating database state to third-party cloud storage providers.
Distinct from Edge-to-Cloud Synchronization: Distinct from Edge-to-Cloud Synchronization: focuses on specific cloud provider integration rather than general edge-to-cloud replication.
Explore 20 awesome GitHub repositories matching data & databases · Cloud Storage Replication. Refine with filters or upvote what's useful.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Replicates local database state to cloud storage folders to enable cross-device synchronization.
KeyDB is a multithreaded in-memory key-value store and distributed cache. It functions as a NoSQL database utilizing multi-version concurrency control to execute non-blocking queries and scans. The project is a multithreaded fork of Redis that maintains protocol compatibility while utilizing a multithreaded architecture to scale across multi-core hardware. It distinguishes itself with flash-tiered storage, allowing the system to offload data from primary RAM to SSD or flash storage to increase total capacity. The system supports high availability through active-active mesh replication and mu
Provides a mechanism to dump and load database snapshots directly to and from remote cloud storage buckets.
Velero is a backup and recovery tool for Kubernetes cluster resources and persistent volumes. It functions as a disaster recovery solution and a utility for migrating applications and their associated data between different clusters. The project enables the replication of production environments by cloning cluster resources into development or testing environments for validation and debugging. It provides capabilities for backing up system objects, restoring resources to a known good state, and transferring applications across environments to facilitate system transitions.
Saves Kubernetes resource manifests and volume snapshots as serialized files in remote cloud object storage buckets.
immudb is a tamperproof database that maintains an immutable record of entries using cryptographic commit logging. It ensures verifiable database integrity by utilizing Merkle trees to generate membership and consistency proofs that detect unauthorized data alterations. The system employs a multi-model storage engine that unifies key-value, document, and relational data structures within a single immutable backend. It provides compatibility with the PostgreSQL wire protocol, allowing it to integrate with standard SQL clients, ORMs, and database tools. The project covers broad capabilities in
Replicates database state to third-party cloud storage providers to enable remote storage for ephemeral deployments.
Noms is a distributed version control database and content-addressable data store. It identifies data by cryptographic hashes to ensure integrity and deduplication, while tracking dataset state changes through a sequence of immutable commits to enable branching, forking, and historical recovery. The system functions as a peer-to-peer data synchronizer, reconciling state between disconnected database instances to ensure all nodes converge on the same data. It distinguishes itself as a schema-flexible document store that supports self-describing types, allowing schemas to evolve and widen as ne
Exports database snapshots to remote cloud object storage buckets for recovery and durability.
Dropbox-Uploader is a Bash-based command-line client for managing files on Dropbox. It provides a full set of file operations including upload, download, copy, move, rename, delete, directory creation, and listing, all through shell scripts that use curl to interact with the Dropbox API. The tool authenticates via OAuth tokens and includes a chunked upload mechanism for handling large files reliably. The project distinguishes itself with an interactive shell interface that lets users browse and manage remote files without re-entering commands, and a file-name-based password derivation system
Compresses a local directory into an encrypted archive and uploads it to a remote cloud storage service.
ZeroByte is a backup management platform built around the Restic backup engine, providing encrypted, deduplicated, and compressed snapshots across multiple storage backends. It offers a web interface for scheduling, monitoring, and managing backup operations, with support for cron-based job scheduling and configurable retention policies that automatically prune older snapshots. The platform distinguishes itself through comprehensive multi-protocol volume mounting, allowing backup ingestion from NFS, SMB, WebDAV, SFTP, and rclone-backed sources alongside local directories. It includes a snapsh
Supports backing up to S3, Google Cloud Storage, Azure Blob, and 40+ rclone backends for remote storage.
Exports and saves note data automatically to cloud storage services like Dropbox or Google Drive.
Android-DataBackup is a rooted Android backup tool that backs up and restores complete application data on devices using Magisk, KernelSU, or APatch. It operates as a root-based backup manager, executing commands through a root shell to bypass Android's sandboxing and access app-specific data directories directly. The tool integrates with Magisk, KernelSU, and APatch to gain root-level access for reading and writing protected application data directories. It compresses backup data into tar archives to preserve file permissions, ownership, and directory structure for reliable restoration, whil
Uploads backup archives to a cloud service for off-device storage and later retrieval.
Duplicacy is a cross-platform, deduplicated backup tool that stores encrypted snapshots to local disks and cloud storage services. It operates through both a command-line executable and a web-based graphical interface, enabling backup, restore, and repository management in scripts or through a browser. The software splits files into variable-size chunks identified by their hash, enabling cross-machine deduplication without a central database or chunk index. Each backup creates an immutable snapshot that stores file metadata and chunk references, supporting incremental updates and point-in-tim
Stores backup data on local disks, SFTP servers, and most cloud storage services without sacrificing essential backup features.
AliSQL is a fork of MySQL by Alibaba that extends the relational database management system with enhancements for high performance, scalability, and enterprise-grade availability. It retains the core MySQL identity as a SQL-based database for storing, organizing, and retrieving structured data, while adding optimizations for large-scale transactional and analytical workloads. The project differentiates itself through a set of Alibaba-specific improvements, including a columnar engine for accelerating analytical queries directly on MySQL tables, and a distributed, shared-nothing NDB Cluster en
MySQL writes a backup directly to a cloud storage bucket (OCI, S3, GCP, OpenStack) for off-site retention.
This project is a PostgreSQL Kubernetes operator and database orchestrator designed to automate the deployment, scaling, and lifecycle management of high-availability database clusters. It functions as a controller that uses declarative manifests to provision and synchronize the state of database instances within a cluster. The system manages high availability through streaming replication and ensures constant availability during maintenance via rolling updates. It also serves as a backup and recovery manager, handling point-in-time recovery, logical backups, and cluster cloning using cloud s
Offloads database snapshots and write-ahead logs to cloud object storage for point-in-time recovery.
宝塔面板 (BaoTa) 是一个基于 Web 的 Linux 服务器控制面板和系统管理仪表盘,专为管理托管环境和系统资源而设计。它提供图形化界面,将管理操作转化为系统级配置,使用户无需完全依赖命令行即可管理 Linux 服务器和 Web 托管栈。 该平台通过 AI 驱动的服务器运维脱颖而出,利用人工智能进行性能分析,并通过自然语言命令执行维护任务。它支持多节点编排,能够从单一界面协调多个服务器实例,实现负载均衡、数据复制和机器迁移。 该软件涵盖了广泛的管理功能,包括 Docker 容器编排、数据库生命周期管理和自动 SSL 证书签发。它提供了全面的安全加固工具,如系统防火墙、暴力破解防护和多因素身份验证,以及用于实时性能跟踪和自动健康报告的监控工具。 面板的安装和部署通过在纯净 Linux 系统上运行命令行脚本来完成。
Schedules automatic backups of websites and databases to third-party object storage or cloud drives.
这是一个 Kubernetes Operator,旨在通过声明式配置部署和管理生产级 PostgreSQL 数据库集群。它作为一个控制器,将数据库集群的实际状态与期望状态同步,提供了一个用于高可用性编排、自动化备份与恢复以及容器化数据库管理的系统。 该 Operator 的特色在于其全面的数据保护套件,支持时间点恢复、到云对象存储的多模式备份以及集群克隆。它使用分布式共识实现自动化故障转移,确保持续可用性,并通过集成的连接池支持复杂的流量管理。 该项目涵盖了广泛的操作功能,包括同步和异步复制、通过专用监控堆栈进行遥测收集,以及具有自动化 TLS 证书轮换的安全身份管理。它还提供了用于存储卷扩展、数据库引擎更新以及集成各种数据库扩展的工具。 该控制器使用可自定义的清单安装到集群中,以实现数据库环境的声明式编排。
Streams full and incremental backups and write-ahead logs to cloud object storage for disaster recovery and point-in-time restoration.
本项目是一个 Telegram 云镜像机器人,旨在从各种互联网源下载文件并将其镜像到 Telegram 或云存储。它作为一个专门用于远程媒体下载、种子和 Usenet 离线下载以及自动内容镜像的服务。 该机器人通过与 Rclone 生态系统的深度集成来管理、克隆和迁移跨多个云服务商的文件,从而脱颖而出。它包括一个 RSS 内容自动化程序,可根据用户定义的过滤器触发下载,并利用服务账户轮换在管理云资源时绕过 API 配额。 该系统涵盖了广泛的功能,包括用于归档提取和格式转换的媒体处理,以及从支持平台进行 Web 媒体捕获。它还具有通过外部 API 进行种子发现、递归云内容搜索以及用于管理大容量传输任务的任务队列。 管理控制通过基于聊天的访问控制以及用于持久化用户配置和任务历史的数据库提供。
Enables the copying of entire folders and files between different cloud storage accounts on the server side.
Valet 是一个 Swift 库,用于管理 Apple 系统钥匙串中跨 iOS 和 macOS 的安全数据存储。它为使用硬件支持的安全隔离区存储和检索敏感字符串及数据对象提供了高级封装。 该项目支持通过基于云的钥匙串服务在多台设备间同步存储的钥匙串数据。它还包括用于在同一开发者的多个应用之间交换安全凭据的机制,使用共享钥匙串访问和应用组授权。 该库涵盖了用于保护数据检索的生物识别身份验证,并管理现有钥匙串条目的迁移和重映射。
Uses system-level synchronization flags to propagate secure entries across devices via a cloud-based keychain service.
wal-g 是一个数据库云备份工具和预写式日志(WAL)归档器,专为灾难恢复和时间点恢复而设计。它将数据库状态和事务日志归档到云存储提供商,以确保数据的长期持久性。 该项目提供了一个管理器,用于压缩、加密和清理存储在云对象存储中的数据库备份。它特别支持通过获取基础备份并重放事务日志,将数据库恢复到特定时间点。 该工具的功能涵盖多引擎备份和恢复,包括生成全量和增量备份。它通过库存跟踪和自动清理策略管理备份生命周期,并包含用于验证日志归档和表文件完整性的实用程序。 提供了一个本地代理来模拟云存储 API,用于测试备份和恢复操作。
Archives database files and transaction logs to cloud storage providers to ensure long-term data durability.
The etcd-operator is a custom resource controller designed to automate the deployment, scaling, backup, and recovery of distributed key-value storage clusters on container orchestration platforms. By extending container orchestration APIs with custom resource definitions, the system manages multi-node database instances through declarative configuration files and a continuous controller reconciliation loop that drives cluster provisioning, scaling, and maintenance. The operator provides automated cluster member recovery, detecting unresponsive nodes and executing membership replacements to pr
Persists point-in-time state snapshot backups to external object storage for disaster recovery.
Editable Website is a content management system built with Svelte that enables direct inline editing of static web pages without needing a database. It functions as a Git-backed web content editor and a component-based static site builder, storing all website text, configuration, and files in local Git repositories to ensure full data ownership and local version control. The platform supports in-browser content management, allowing users to modify text, format styles, and compose structured page layouts using interactive blocks, drag-and-drop interactions, and keyboard shortcuts. Additional
Replicates database changes and mirrors uploaded assets to an S3-compatible bucket on every write operation.
Container-db-backup is a container-native utility designed to automate database maintenance, including recurring backups, data restoration, and secure archiving. It operates by executing isolated backup jobs within ephemeral containers, ensuring consistent environments for data protection workflows across multiple database hosts. The tool distinguishes itself through a pipeline-oriented processing model that streams database dumps through compression and encryption stages before storage. It supports flexible storage configurations, allowing data to be directed to local filesystems or remote S
Uploads backup files to remote object storage using secure connections for off-site redundancy.