25 个仓库
Services and utilities for automating data backups to cloud storage providers.
Distinguishing note: Focuses on disaster recovery and cloud storage rather than general data management.
Explore 25 awesome GitHub repositories matching devops & infrastructure · Cloud Backups. Refine with filters or upvote what's useful.
This project is an enterprise knowledge platform designed for teams to create, manage, and publish structured documentation. Built on a high-performance runtime, it provides a centralized environment where contributors can author content using markdown, HTML, or a visual editor. The system is engineered to handle collaborative workflows, ensuring that technical and non-technical users alike can maintain documentation with consistent rendering and version control. What distinguishes this platform is its focus on secure, scalable, and synchronized content management. It features granular path-b
Protects data by backing up content to enterprise cloud storage providers like AWS S3.
Wekan 是一个开源、自托管的看板项目管理工具,用于通过看板、列表和卡片组织工作流。它是一个实时 Web 应用程序,允许团队在私有基础设施上管理任务。 该平台的特色在于其广泛的数据迁移工具,特别是用于从 Trello 导入看板和卡片。它支持通过 LDAP、OpenID Connect 和 OAuth2 进行企业级身份集成,并提供灵活的存储选项,包括作为主要关系后端的 PostgreSQL 和用于附件的可插拔云存储。 该系统涵盖了广泛的任务管理功能,包括甘特图可视化、时间跟踪和跨看板任务聚合。它包括用于基于角色的访问控制、自动化备份调度以及通过 REST API 和事件驱动 Webhook 进行编程扩展的管理工具。 该应用程序可通过 Docker 部署,并支持多租户配置。
Automates the backup of system state and attachments to cloud storage providers for disaster recovery.
Duplicati is a self-hosted backup server designed to perform encrypted, incremental, and compressed backups to a wide range of local, network, and cloud-based storage providers. It functions as a background service that automates recurring data protection tasks, ensuring that only changed data blocks are stored to maximize efficiency and minimize bandwidth usage. The project distinguishes itself through a centralized management console that allows for the orchestration of multiple distributed backup agents from a single web-based dashboard. It supports multi-tenant management, enabling the or
Performs encrypted, incremental, and compressed backups to local, network, or cloud-based storage providers.
Cookiecutter Django is a command-line utility designed to generate production-ready web application structures based on the Django framework. It functions as a standardized boilerplate generator that automates the initial setup of a project, providing a consistent foundation that includes pre-configured settings, security defaults, and integrated infrastructure services. The project distinguishes itself by providing a fully containerized development and deployment environment. It orchestrates multi-container stacks that manage databases, background workers, and web servers, ensuring that the
Synchronizes database backup files with remote object storage for off-site data redundancy.
This project is a command-line synchronization client for OneDrive and SharePoint libraries on Linux. It functions as a synchronization engine that aligns local filesystems with cloud storage through bidirectional, unidirectional, or download-only workflows. The client supports headless authentication for servers without web browsers and can be deployed as a background service or within a containerized environment. It enables the management of multiple distinct cloud accounts on a single system and integrates with shared SharePoint sites and document libraries. The synchronization engine inc
Facilitates a cloud backup workflow using unidirectional synchronization to upload local files.
Kopia is a backup utility designed to create encrypted, deduplicated, and compressed snapshots of files and directories. It functions as a client-side tool that secures data locally before transmitting it to various storage targets, ensuring that sensitive information remains protected throughout the backup process. The system utilizes content-addressable block storage and metadata-driven versioning to identify and remove redundant data across multiple snapshots. By employing a pluggable storage abstraction layer, it supports a wide range of local, network, and cloud-based storage providers,
Provides a backup utility that synchronizes encrypted data blocks to remote cloud storage providers.
KeyDB is a multithreaded in-memory key-value store and distributed cache. It functions as a NoSQL database utilizing multi-version concurrency control to execute non-blocking queries and scans. The project is a multithreaded fork of Redis that maintains protocol compatibility while utilizing a multithreaded architecture to scale across multi-core hardware. It distinguishes itself with flash-tiered storage, allowing the system to offload data from primary RAM to SSD or flash storage to increase total capacity. The system supports high availability through active-active mesh replication and mu
Provides native capabilities to dump and load database state directly to and from remote cloud storage buckets.
Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain
Provides a comprehensive programmatic interface to create, migrate, restore, and delete cloud backups.
bypy is a Python client for interacting with Baidu Yun cloud storage via its official API. It functions as both a library for programmatic integration and a command-line manager for organizing and listing files within a cloud account. The project features a multi-process transfer tool that utilizes parallel processing to accelerate high-volume uploads and downloads. It provides bidirectional directory synchronization to align content between local file systems and remote cloud storage by identifying missing or outdated files. The tool covers recursive file transfers, automated cloud data bac
Automates data backups of local files and directories to cloud storage using recursive uploads.
WechatExporter is a chat backup conversion tool designed to extract WeChat chat records from backups and convert them into human-readable text, HTML, or PDF files for archiving. It functions as a data extraction system that transforms proprietary messaging database backups into standardized document formats. The project includes a template-based document generator that allows users to modify the visual layout and formatting of exported conversation records. It also features an incremental export system that tracks and saves only new messages sent since the previous export to prevent data dupl
Transforms proprietary messaging database backups into standardized and human-readable document formats.
本项目通过将完整的 GitLab 安装打包到 Docker 镜像中,提供了一个容器化的 DevOps 平台。它支持部署自托管环境,在私有基础设施上集成 Git 版本控制、项目管理以及持续集成和交付流水线。 该实现支持通过 Docker Compose 部署或通过 Docker Swarm 进行编排,允许使用集成容器注册表的扩展堆栈。它利用环境变量进行配置,并支持将工件和备份卸载到远程对象存储和外部数据库容器。 该平台涵盖了广泛的操作功能,包括与 LDAP、SAML 和 OAuth 的身份集成,以及自动化系统备份和恢复例程。它还包括用于通过 SSL/TLS 配置进行安全网络连接、代理流量路由以及托管静态项目页面的工具。 管理任务通过用于维护和健康监控的命令行实用程序进行管理,而系统通信则通过 SMTP 和 IMAP 配置进行处理。
Automatically uploads backup archives to remote cloud providers for offsite redundancy.
This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the
Instructs on using services and utilities to automate data backups to cloud storage providers.
Remotely Save is a cloud storage synchronization tool and backup manager designed to keep local files and application data consistent across desktop and mobile devices. It functions as a cross-platform synchronizer that mirrors local data to remote servers using S3 and other cloud protocols. The project focuses on privacy and security through end-to-end encryption, which secures files with a user-defined password before they are uploaded to remote cloud services. It ensures data remains private on third-party servers by applying symmetric client-side encryption. The system includes capabilit
Provides utilities for automating regular data backups to cloud storage providers like S3, Dropbox, and Google Drive.
Dropbox-Uploader is a Bash-based command-line client for managing files on Dropbox. It provides a full set of file operations including upload, download, copy, move, rename, delete, directory creation, and listing, all through shell scripts that use curl to interact with the Dropbox API. The tool authenticates via OAuth tokens and includes a chunked upload mechanism for handling large files reliably. The project distinguishes itself with an interactive shell interface that lets users browse and manage remote files without re-entering commands, and a file-name-based password derivation system
Automates encrypted backups by compressing local directories and uploading them to Dropbox cloud storage.
ZeroByte is a backup management platform built around the Restic backup engine, providing encrypted, deduplicated, and compressed snapshots across multiple storage backends. It offers a web interface for scheduling, monitoring, and managing backup operations, with support for cron-based job scheduling and configurable retention policies that automatically prune older snapshots. The platform distinguishes itself through comprehensive multi-protocol volume mounting, allowing backup ingestion from NFS, SMB, WebDAV, SFTP, and rclone-backed sources alongside local directories. It includes a snapsh
Sends encrypted backup snapshots to S3, Google Cloud, Azure Blob, and 40+ rclone-supported cloud providers.
Android-DataBackup is a rooted Android backup tool that backs up and restores complete application data on devices using Magisk, KernelSU, or APatch. It operates as a root-based backup manager, executing commands through a root shell to bypass Android's sandboxing and access app-specific data directories directly. The tool integrates with Magisk, KernelSU, and APatch to gain root-level access for reading and writing protected application data directories. It compresses backup data into tar archives to preserve file permissions, ownership, and directory structure for reliable restoration, whil
Uploads backup archives to cloud storage for off-device preservation and later retrieval.
Duplicacy is a cross-platform, deduplicated backup tool that stores encrypted snapshots to local disks and cloud storage services. It operates through both a command-line executable and a web-based graphical interface, enabling backup, restore, and repository management in scripts or through a browser. The software splits files into variable-size chunks identified by their hash, enabling cross-machine deduplication without a central database or chunk index. Each backup creates an immutable snapshot that stores file metadata and chunk references, supporting incremental updates and point-in-tim
Stores deduplicated, encrypted snapshots to local disks and cloud storage services via CLI and web interface.
Memex 是一个浏览器扩展知识库和个人信息管理器,旨在将 Web 内容索引、注释并组织到可搜索的个人档案中。它作为 Web 注释工具,允许用户直接向网页和 PDF 添加高亮和笔记。 该系统具有 AI 驱动的文档摘要器,可根据索引材料使用引用的参考资料生成简洁的答案和摘要。它包括一个加密内容同步器,使用端到端加密在多个设备之间镜像档案和注释。 该平台提供跨书签网站和文档的全文搜索和过滤内容检索功能。它涵盖了通过浏览器标签组织和自动化标记进行的内容管理,以及通过本地优先存储和云备份进行的数据持久化。 该项目提供标准化 API,将保存的知识连接到外部工具和 AI 代理,以实现可互操作的信息共享。
Saves and restores personal knowledge data to external cloud providers for recovery.
BaiduPCS-Go is a Go library and cloud storage client that provides a programmable interface for interacting with Baidu Cloud Storage. It functions as an API wrapper and remote file manager, allowing users to manage files, folders, and accounts without using a web browser. The project includes specialized utilities for extracting direct download URLs to bypass web downloaders and managing multiple cloud identities through session tokens and cookies. It also enables remote file transfers, allowing content from shared links to be moved directly into a cloud account. The system covers a broad ra
Enables automated uploading and synchronization of local files to cloud storage for data persistence.
Replibyte is a tool that automates the lifecycle of database snapshots for non-production environments, handling the export, anonymization, subsetting, and restoration of data. It is designed to support privacy-compliant development workflows by replacing sensitive production data with synthetic values and extracting consistent subsets of rows while preserving referential integrity. The tool operates through a configurable pipeline defined in a YAML file, orchestrating stages such as dump, anonymize, subset, and restore. Each operation runs as an isolated, ephemeral container job, and snapsho
Automates dumping, encrypted storage, and lifecycle cleanup of database snapshots in cloud object storage.