Snapshot management tools

pgBackRest is a distributed backup and restore tool for PostgreSQL. It functions as an incremental backup engine and point-in-time recovery manager, enabling the creation of full, differential, and incremental backups across local and remote repositories. The system is distinguished by its block-level incremental backups, which reduce storage and transfer time by saving only modified data. It integrates with S3-compatible object storage via HTTP and utilizes parallel processing to maximize throughput during backup and restoration operations. The tool covers comprehensive disaster recovery ca

Litestream is a database backup utility that provides continuous, incremental replication for SQLite databases. It operates as a background process that monitors local database files and streams modifications to remote cloud storage, ensuring that off-site backups are maintained without manual intervention. The tool functions by intercepting the database file system layer to capture page-level changes and tailing the write-ahead log. This approach allows for real-time synchronization of transactions to various cloud object storage providers through a unified abstraction layer. Beyond continu

wal-g is a database cloud backup tool and write-ahead log archiver designed for disaster recovery and point-in-time recovery. It archives database state and transaction logs to cloud storage providers to ensure long-term data durability. The project provides a manager for compressing, encrypting, and pruning database backups stored in cloud object storage. It specifically enables the restoration of a database to a specific timestamp by fetching base backups and replaying transaction logs. The tool's capabilities cover multi-engine backup and restoration, including the generation of full and

Velero is a backup and recovery tool for Kubernetes cluster resources and persistent volumes. It functions as a disaster recovery solution and a utility for migrating applications and their associated data between different clusters. The project enables the replication of production environments by cloning cluster resources into development or testing environments for validation and debugging. It provides capabilities for backing up system objects, restoring resources to a known good state, and transferring applications across environments to facilitate system transitions.

Duplicacy is a cross-platform, deduplicated backup tool that stores encrypted snapshots to local disks and cloud storage services. It operates through both a command-line executable and a web-based graphical interface, enabling backup, restore, and repository management in scripts or through a browser. The software splits files into variable-size chunks identified by their hash, enabling cross-machine deduplication without a central database or chunk index. Each backup creates an immutable snapshot that stores file metadata and chunk references, supporting incremental updates and point-in-tim

This project is a Unix backup orchestrator used for modeling and executing full-stack data protection. It functions as a management system for database dumps, encrypted archiving, version rotation, and remote storage transport. The system distinguishes itself by orchestrating native system tools for various databases, including PostgreSQL, MySQL, MongoDB, Redis, and Riak. It employs a secure archive workflow that combines compression and encryption using GPG, OpenSSL, or AES before transporting packages to S3-compatible services, Dropbox, or remote servers via SFTP and RSync. Broad capabilit

This utility is a command-line tool designed to create incremental, time-stamped snapshots of local or remote data. It functions as a shell-based orchestrator that coordinates system utilities to maintain versioned file archives, allowing for the restoration of specific data states without the need for proprietary software. The tool distinguishes itself by using filesystem hard links to reference unchanged files across multiple snapshots, which minimizes storage consumption while keeping each backup directory structure independent. It incorporates a dedicated retention manager that automatica

bup is a deduplicating backup manager and incremental backup system. It uses a Git packfile-based storage format to eliminate redundant data across files and versions, treating every incremental save as a full backup. The system provides secure remote transport interfaces for transferring and managing backup data on remote servers via SSH. It also includes a backup repository browser available as both a web interface and a filesystem mount for exploring and retrieving files from snapshots. The project covers broad capability areas including disaster recovery, repository administration, and s

Longhorn is a distributed block storage system and orchestrator for Kubernetes. It provides persistent, replicated block storage volumes that survive pod restarts and node failures by maintaining synchronous copies of data across multiple cluster nodes. The system implements the Container Storage Interface (CSI) for dynamic volume provisioning and attachment. It is distinguished by its support for shared read-write access to a single block volume across multiple pods, as well as the ability to export volume snapshots to external S3 or NFS targets for off-cluster disaster recovery. The platfo

This project is a Kubernetes operator designed for deploying and managing production PostgreSQL database clusters using declarative configurations. It functions as a controller that synchronizes the actual state of database clusters with a desired state, providing a system for high availability orchestration, automated backup and recovery, and containerized database administration. The operator distinguishes itself through a comprehensive data protection suite that supports point-in-time recovery, multi-mode backups to cloud object storage, and cluster cloning. It ensures continuous availabil

This project is a command-line utility designed for secure, content-addressable data archiving. It functions as an encrypted backup tool that stores data as deduplicated chunks, ensuring that every piece of information is identified by a cryptographic hash to maintain integrity across all backups. By applying strong encryption and message authentication codes to both data and metadata, the software prevents unauthorized access and detects potential tampering. The tool distinguishes itself through a backend-agnostic storage abstraction that allows users to maintain repositories across diverse

This project is a Docker volume backup tool and data lifecycle manager that archives volume data to local storage, SSH, or cloud providers. It operates as a containerized backup orchestrator and companion container that coordinates volume snapshots and manages the restoration of data for disaster recovery. The tool distinguishes itself through integrated security and consistency controls, utilizing GPG or age encryption to secure archives before remote transmission. It ensures data integrity by managing container states, such as stopping services or running database dump utilities via lifecyc

Duplicati is a self-hosted backup server designed to perform encrypted, incremental, and compressed backups to a wide range of local, network, and cloud-based storage providers. It functions as a background service that automates recurring data protection tasks, ensuring that only changed data blocks are stored to maximize efficiency and minimize bandwidth usage. The project distinguishes itself through a centralized management console that allows for the orchestration of multiple distributed backup agents from a single web-based dashboard. It supports multi-tenant management, enabling the or

Borg is a command-line backup utility designed for deduplicated data archiving and secure storage. It functions by identifying unique file chunks and applying compression to minimize the total storage footprint across multiple backup versions. The software distinguishes itself through the use of authenticated encryption, which ensures that all stored data remains confidential and protected against unauthorized tampering. It also provides a virtual filesystem interface, allowing users to mount archives as local directories to browse and access individual files without performing a full restora

Kopia is a backup utility designed to create encrypted, deduplicated, and compressed snapshots of files and directories. It functions as a client-side tool that secures data locally before transmitting it to various storage targets, ensuring that sensitive information remains protected throughout the backup process. The system utilizes content-addressable block storage and metadata-driven versioning to identify and remove redundant data across multiple snapshots. By employing a pluggable storage abstraction layer, it supports a wide range of local, network, and cloud-based storage providers,

Backup Manager is a command-line utility designed to automate the export, compression, and restoration of database snapshots. It functions as a centralized tool for managing database disaster recovery by facilitating the transfer of data to both local and remote storage environments. The project distinguishes itself through a configuration-driven approach to task scheduling, allowing for the automation of routine backup operations without manual intervention. It utilizes a pipeline-based processing model that streams database output through encryption and compression filters before routing th

This tool is a command-line utility designed for managing the lifecycle of persistent storage within containerized environments. It facilitates the migration, backup, and restoration of data between persistent volume claims across different namespaces, clusters, or storage classes. By automating these tasks, it supports infrastructure scaling, disaster recovery, and general storage administration. The project distinguishes itself through its orchestration of ephemeral jobs that execute data transfers in the background, ensuring operations continue even if the client session is disconnected. I

A Python/Boto script that automates snapshot making of EBS volumes and rotating.