Fclones

Features

Duplicate File Finders - Scans storage to identify files with identical content for deduplication and review.
Content-Based Deduplication - Eliminates redundant data by identifying identical files through cryptographic content hashing.
Incremental Scan Caches - Stores file hashes and metadata on disk to accelerate repeated scans by skipping unchanged files.
Storage Reclamation Utilities - Reclaims disk space by identifying and removing unnecessary duplicate files.
Hard Link Management - Replaces duplicate file copies with hard links to the same inode to reclaim disk space.
Parallel Filesystem Scanning - Scans large volumes of data using parallel I/O and hardware-aware scheduling to find duplicates efficiently.
Link-Based File Substitution - Substitutes duplicate files with hard or symbolic links to save disk space while maintaining accessibility.
Reflink-Based Deduplication - Reclaims disk space by using filesystem reflinks to share data blocks between duplicate files.
Filesystem Scanners - Implements a high-performance scanner that traverses storage media to identify duplicate files.
Reflink Deduplication - Uses filesystem copy-on-write reflinks to share data blocks between identical files without deleting them.
Multi-Phase Hashing Strategies - Minimizes disk I/O by filtering files via size and partial hashes before computing full cryptographic signatures.
Hardware-Aware Scheduling - Adjusts thread pool concurrency and I/O scheduling based on whether the storage is an SSD or HDD to maximize throughput.
Persistent Hash Caching - Stores file hashes on disk and verifies modification times and sizes to avoid re-hashing unchanged files.
Redundant File Scanning - Scans the filesystem to identify and remove duplicate files to reclaim storage space.
Replica Count Thresholds - Allows users to set minimum or maximum replica counts per content group for deduplication and replication analysis.
Multi-Phase Hashing - Scans files in stages by size, partial hashes, and then full hashes to minimize I/O and CPU usage.
Dry Run Simulations - Provides a preview mode to simulate and verify filesystem changes before they are executed.
Device-Aware I/O Scheduling - Adjusts thread-pool sizes and I/O concurrency based on storage device type to maximize throughput.
Scan Concurrency Control - Manages the number of threads used for scanning and I/O to balance performance and system load.
File Hash Verification - Stores computed file hashes and validates them against metadata to avoid re-hashing unchanged files.
File Redundancy Analysis - Identifies files that are under-replicated or over-replicated based on a configurable threshold to ensure data redundancy.
System Utilities - Efficient duplicate file finder.

Open-source alternatives to Fclones

Similar open-source projects, ranked by how many features they share with Fclones.

qarmin/czkawka
qarmin/czkawka
31,526View on GitHub
Czkawka is a cross-platform utility designed for storage optimization and filesystem maintenance. It functions as a comprehensive file analysis engine that identifies redundant data, including duplicate files, empty directories, broken symbolic links, and temporary files. By utilizing hash-based content verification, the tool ensures accurate identification of duplicates regardless of file names or metadata. The project distinguishes itself by offering both a native graphical user interface and a command-line interface, allowing for both interactive management and automated, headless system m
Fluentcleanerduplicatesmultiplatform
View on GitHub31,526
ouch-org/ouch
ouch-org/ouch
3,391View on GitHub
Ouch is a command-line archive utility designed for compressing and decompressing files across multiple formats, including zip, tar, 7z, and zstd. It functions as a secure archive processor that sanitizes metadata to prevent path traversal attacks and terminal injection during extraction. The tool features a chain compression pipeline that allows for the sequential application of multiple compression algorithms by parsing chains of file extensions in a filename. It also includes a dedicated accessibility mode that optimizes terminal output for screen readers and text-to-speech technologies by
Rustclicompressiondecompression
View on GitHub3,391
arsenetar/dupeguru
arsenetar/dupeguru
7,631View on GitHub
dupeguru is a content-based file deduplicator and cross-platform disk cleanup tool. It functions as a local file management utility designed to identify and remove redundant files to recover disk space. The application identifies identical files across a file system by using content hashing and metadata comparison. This allows it to detect duplicates regardless of their filenames or directory locations. The software covers a range of data management capabilities, including directory scanning, content-based data deduplication, and the consolidation of redundant copies into single versions. It
Python
View on GitHub7,631
d4rken-org/sdmaid-se
d4rken-org/sdmaid-se
6,995View on GitHub
SD Maid SE is an Android storage optimization and system maintenance utility. It focuses on reclaiming disk space by analyzing storage usage and removing duplicate, orphaned, or unused files. The project distinguishes itself through the use of accessibility services to automate repetitive device tasks and manual file reviews by simulating user interactions. It also includes specialized tools for reducing the file size of images and videos through media compression. The system provides a broad range of capabilities including application lifecycle management to freeze or remove software, junk
Kotlin
View on GitHub6,995

See all 30 alternatives to Fclones

pkolaczkfclones

Features

Open-source alternatives to Fclones

qarmin/czkawka

ouch-org/ouch

arsenetar/dupeguru

d4rken-org/sdmaid-se

Star history

Open-source alternatives to Fclones

qarmin/czkawka

ouch-org/ouch

arsenetar/dupeguru

d4rken-org/sdmaid-se