Duplicacy

Duplicacy is a cross-platform, deduplicated backup tool that stores encrypted snapshots to local disks and cloud storage services. It operates through both a command-line executable and a web-based graphical interface, enabling backup, restore, and repository management in scripts or through a browser. The software splits files into variable-size chunks identified by their hash, enabling cross-machine deduplication without a central database or chunk index.

Each backup creates an immutable snapshot that stores file metadata and chunk references, supporting incremental updates and point-in-time restoration. Chunks are stored as individual files named by their hash, eliminating the need for a local database. Unreferenced chunks are removed in a two-phase garbage collection process that prevents deletion of chunks still in use by concurrent operations. The web interface provides scheduling for recurring backup, check, copy, or prune operations with configurable execution order and parallelism.

The tool supports a wide range of storage destinations including local disks, SFTP servers, Amazon S3, Backblaze B2, Google Cloud Storage, Google Drive, Dropbox, Microsoft Azure, DigitalOcean Spaces, Wasabi, NetApp StorageGRID, and Samba shares. Additional remote storage destinations can be added to a single repository for simultaneous backups to different locations. The web GUI allows configuring listening addresses, enabling HTTPS with automatic Let's Encrypt certificates, and running as a Windows service that starts automatically with the operating system.

Features

Cloud Backups - Stores deduplicated, encrypted snapshots to local disks and cloud storage services via CLI and web interface.
Backup Snapshot Managements - Lists, verifies, compares, and restores files from historical backup revisions with pruning capabilities.
Chunk-Based Deduplicators - Splits files into variable-size chunks identified by hash for cross-machine deduplication without central coordination.
Backup Job Configurations - Selects a source directory, storage destination, and unique Backup ID to define what data to protect.
Storage Driver Abstractions - Implements a unified storage interface with interchangeable backend drivers for local disks, SFTP, S3, and cloud services.
Cloud Storage Backups - Stores backup data on local disks, SFTP servers, and most cloud storage services without sacrificing essential backup features.
Hash-Named Chunk Storages - Saves each deduplication chunk as an individual file named by its hash, removing the need for a central chunk index.
Garbage Collection Operations - Removes unreferenced chunks in two phases, preventing deletion of chunks still needed by concurrent backups.
Stateless File Systems - Stores chunks as individual files named by their hash, eliminating the need for a local database or chunk index.
Backup Command-Line Executions - Invokes the backup engine through a command-line executable for manual execution or scripted automation.
Immutable Revision Snapshots - Creates immutable point-in-time snapshots storing file metadata and chunk references for incremental updates and restoration.
Repository Initialization - Connects a local directory to a remote storage location with a unique repository ID for deduplication.
Incremental Backup Storage - Uploads only new or modified files since the last backup, making subsequent backups faster.
File System Incremental Backups - Uploads only new or modified files since the last backup, making subsequent backups faster than the initial full backup.
Two-Phase Garbage Collections - Removes unreferenced chunks in two phases to prevent deletion of chunks still in use by concurrent operations.
Backup - Provides a command-line executable for running backups, restores, and repository management in scripts or manual workflows.
Web and CLI Dual Interfaces - Provides both a command-line executable and a web-based graphical interface for backup operations.
Backup Snapshot Managements - Lists, verifies, compares, and restores files from historical backup revisions with pruning capabilities.
Cross-Platform Managements - Manages backup repositories and snapshots across different operating systems through a web GUI or CLI.
General File Restorations from Backups - Rolls back a repository to a previous revision by downloading and reconstructing files from remote storage.
Deduplication Backup Tools - Splits files into variable-size chunks identified by hash, enabling cross-machine deduplication without a central database.
Local Directory Backups - Supports storing backup snapshots on local disk directories across operating systems.
Backup Destinations - Ships a dedicated backend for storing backup snapshots on Google Drive.
Multi-Destination Backup Storages - Adds multiple remote storage destinations to a single repository for simultaneous backups.
Storage Backend Configurations - Configures new backup targets by selecting local or cloud directories with optional encryption passwords.
Dropbox Connectors - Stores backup data in a Dropbox application folder using a long-lived refresh token for authentication.
Amazon S3 Backup Storages - Stores backup data on Amazon S3 or S3-compatible storage using access keys and region-specific URLs.
Backblaze B2 Connectors - Connects to Backblaze B2 cloud storage for backup with low per-GB monthly cost and free download allowance.
Retention Policy Pruning - Removes backup revisions by revision number, tag, or retention policy, then cleans up unreferenced data chunks.
Backup Job Scheduling - Schedules recurring backup, check, copy, or prune operations with configurable execution order and parallelism.
SFTP File Transfers - Transfers backup data to remote servers via SFTP with password or public key authentication.
Azure Backup and Restore - Stores encrypted backup snapshots on Microsoft Azure Blob Storage using an account access key.
Backup Management Web Services - Provides a graphical web interface for configuring, scheduling, and monitoring backup jobs with statistical charts.
Backup and Recovery - Cross-platform cloud backup tool with deduplication support.
File Storage Systems - Lock-free cloud backup tool.
Software Tools - Cross-platform cloud backup tool.

bup/bup

7,324View on GitHub

bup is a deduplicating backup manager and incremental backup system. It uses a Git packfile-based storage format to eliminate redundant data across files and versions, treating every incremental save as a full backup. The system provides secure remote transport interfaces for transferring and managing backup data on remote servers via SSH. It also includes a backup repository browser available as both a web interface and a filesystem mount for exploring and retrieving files from snapshots. The project covers broad capability areas including disaster recovery, repository administration, and s

restic/restic

34,445View on GitHub

This project is a command-line utility designed for secure, content-addressable data archiving. It functions as an encrypted backup tool that stores data as deduplicated chunks, ensuring that every piece of information is identified by a cryptographic hash to maintain integrity across all backups. By applying strong encryption and message authentication codes to both data and metadata, the software prevents unauthorized access and detects potential tampering. The tool distinguishes itself through a backend-agnostic storage abstraction that allows users to maintain repositories across diverse

nicotsx/zerobyte

6,572View on GitHub

ZeroByte is a backup management platform built around the Restic backup engine, providing encrypted, deduplicated, and compressed snapshots across multiple storage backends. It offers a web interface for scheduling, monitoring, and managing backup operations, with support for cron-based job scheduling and configurable retention policies that automatically prune older snapshots. The platform distinguishes itself through comprehensive multi-protocol volume mounting, allowing backup ingestion from NFS, SMB, WebDAV, SFTP, and rclone-backed sources alongside local directories. It includes a snapsh

kopia/kopia

12,612View on GitHub

Kopia is a backup utility designed to create encrypted, deduplicated, and compressed snapshots of files and directories. It functions as a client-side tool that secures data locally before transmitting it to various storage targets, ensuring that sensitive information remains protected throughout the backup process. The system utilizes content-addressable block storage and metadata-driven versioning to identify and remove redundant data across multiple snapshots. By employing a pluggable storage abstraction layer, it supports a wide range of local, network, and cloud-based storage providers,

gilbertchenduplicacy

Features