google/cdc-file-transferArchived
Cdc File Transfer
Cdc-file-transfer is a file synchronization and transfer tool that calculates delta changes using content-defined chunking to transmit only modified segments across systems. It operates as a command line utility designed to sync and stream files between Windows and Linux operating system environments.
The software splits files into variable-length blocks based on content patterns rather than fixed offsets to identify matching segments despite insertions or deletions. It isolates operating-system-specific file system APIs behind unified interfaces and calculates modified chunk hashes and missing byte ranges to minimize network bandwidth during updates. Additional capabilities include recursive directory tree synchronization, local block caching to store fetched remote chunks, and virtual file system mounting that exposes remote storage locations as local directory trees by intercepting system calls and fetching data dynamically on demand.
Features
- Remote File System Mounts - Exposes remote storage locations as local directory trees by intercepting system calls and fetching data dynamically on demand.
- File Sync and Transfer - Transfers files and directories between systems recursively while skipping unchanged items and compressing data.
- Delta Compression Bandwidth Optimizations - Calculates and transmits only modified chunk hashes and missing byte ranges to minimize network bandwidth during updates.
- Content-Defined Chunking - Splits files into variable-length blocks using content patterns to identify matching segments despite insertions or deletions.
- File Synchronizers - Provides a file synchronization tool that calculates delta changes using content-defined chunking to transmit only modified segments.
- Command-Line File Transfers - Provides a command line utility for syncing and streaming files between Windows and Linux operating system environments.
- Delta Synchronization - Transfers modified files between systems by calculating differences using content-defined chunking to accelerate updates.
- Remote Drive Mounts - Mounts remote directories locally to fetch file data on demand and cache reads for improved performance.
- Cross-Platform File Synchronization - Synchronizes files and directories across different operating systems while compressing data and skipping unchanged items.
- Delta Transfer Protocols - Accelerates file updates between systems by detecting modified portions using content-defined chunking and transmitting differences.
- Recursive Directory Synchronization - Walks directory hierarchies to compare metadata states across operating systems and selectively copy modified paths.
- On-Demand Remote - Makes remote directories immediately available as a read-only view and fetches requested file content on demand.
- Local Caching Layers - Stores fetched remote chunks in a local persistence layer to accelerate subsequent read requests and minimize round trips.
- Remote Data Streaming - Supports mounting and accessing remote directories locally by fetching file data dynamically and caching reads.
- Cross-Platform File Operations - Copies files between different operating system environments using specialized command line tools.
- Cross-Platform Abstraction Layers - Isolates operating-system-specific file system APIs behind unified interfaces for seamless cross-platform execution.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
