gilbertchen/duplicacy
Duplicacy
Duplicacy is a cross-platform, deduplicated backup tool that stores encrypted snapshots to local disks and cloud storage services. It operates through both a command-line executable and a web-based graphical interface, enabling backup, restore, and repository management in scripts or through a browser. The software splits files into variable-size chunks identified by their hash, enabling cross-machine deduplication without a central database or chunk index.
Each backup creates an immutable snapshot that stores file metadata and chunk references, supporting incremental updates and point-in-time restoration. Chunks are stored as individual files named by their hash, eliminating the need for a local database. Unreferenced chunks are removed in a two-phase garbage collection process that prevents deletion of chunks still in use by concurrent operations. The web interface provides scheduling for recurring backup, check, copy, or prune operations with configurable execution order and parallelism.
The tool supports a wide range of storage destinations including local disks, SFTP servers, Amazon S3, Backblaze B2, Google Cloud Storage, Google Drive, Dropbox, Microsoft Azure, DigitalOcean Spaces, Wasabi, NetApp StorageGRID, and Samba shares. Additional remote storage destinations can be added to a single repository for simultaneous backups to different locations. The web GUI allows configuring listening addresses, enabling HTTPS with automatic Let's Encrypt certificates, and running as a Windows service that starts automatically with the operating system.
Features
- Cloud Backups - Stores deduplicated, encrypted snapshots to local disks and cloud storage services via CLI and web interface.
- Backup Snapshot Managements - Lists, verifies, compares, and restores files from historical backup revisions with pruning capabilities.
- Chunk-Based Deduplicators - Splits files into variable-size chunks identified by hash for cross-machine deduplication without central coordination.
- Backup Job Configurations - Selects a source directory, storage destination, and unique Backup ID to define what data to protect.
- Storage Driver Abstractions - Implements a unified storage interface with interchangeable backend drivers for local disks, SFTP, S3, and cloud services.
- Cloud Storage Backups - Stores backup data on local disks, SFTP servers, and most cloud storage services without sacrificing essential backup features.
- Hash-Named Chunk Storages - Saves each deduplication chunk as an individual file named by its hash, removing the need for a central chunk index.
- Garbage Collection Operations - Removes unreferenced chunks in two phases, preventing deletion of chunks still needed by concurrent backups.
- Stateless File Systems - Stores chunks as individual files named by their hash, eliminating the need for a local database or chunk index.
- Backup Command-Line Executions - Invokes the backup engine through a command-line executable for manual execution or scripted automation.
- Immutable Revision Snapshots - Creates immutable point-in-time snapshots storing file metadata and chunk references for incremental updates and restoration.
- Repository Initialization - Connects a local directory to a remote storage location with a unique repository ID for deduplication.
- Incremental Backup Storage - Uploads only new or modified files since the last backup, making subsequent backups faster.
- File System Incremental Backups - Uploads only new or modified files since the last backup, making subsequent backups faster than the initial full backup.
- Two-Phase Garbage Collections - Removes unreferenced chunks in two phases to prevent deletion of chunks still in use by concurrent operations.
- Backup - Provides a command-line executable for running backups, restores, and repository management in scripts or manual workflows.
- Web and CLI Dual Interfaces - Provides both a command-line executable and a web-based graphical interface for backup operations.
- Backup Snapshot Managements - Lists, verifies, compares, and restores files from historical backup revisions with pruning capabilities.
- Cross-Platform Managements - Manages backup repositories and snapshots across different operating systems through a web GUI or CLI.
- General File Restorations from Backups - Rolls back a repository to a previous revision by downloading and reconstructing files from remote storage.
- Deduplication Backup Tools - Splits files into variable-size chunks identified by hash, enabling cross-machine deduplication without a central database.
- Local Directory Backups - Supports storing backup snapshots on local disk directories across operating systems.
- Backup Destinations - Ships a dedicated backend for storing backup snapshots on Google Drive.
- Multi-Destination Backup Storages - Adds multiple remote storage destinations to a single repository for simultaneous backups.
- Storage Backend Configurations - Configures new backup targets by selecting local or cloud directories with optional encryption passwords.
- Dropbox Connectors - Stores backup data in a Dropbox application folder using a long-lived refresh token for authentication.
- Amazon S3 Backup Storages - Stores backup data on Amazon S3 or S3-compatible storage using access keys and region-specific URLs.
- Backblaze B2 Connectors - Connects to Backblaze B2 cloud storage for backup with low per-GB monthly cost and free download allowance.
- Retention Policy Pruning - Removes backup revisions by revision number, tag, or retention policy, then cleans up unreferenced data chunks.
- Backup Job Scheduling - Schedules recurring backup, check, copy, or prune operations with configurable execution order and parallelism.
- SFTP File Transfers - Transfers backup data to remote servers via SFTP with password or public key authentication.
- Azure Backup and Restore - Stores encrypted backup snapshots on Microsoft Azure Blob Storage using an account access key.
- Backup Management Web Services - Provides a graphical web interface for configuring, scheduling, and monitoring backup jobs with statistical charts.
- Backup and Recovery - Cross-platform cloud backup tool with deduplication support.
- File Storage Systems - Lock-free cloud backup tool.
- Software Tools - Cross-platform cloud backup tool.
