# google/cdc-file-transfer **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/google-cdc-file-transfer).** _How this analysis was created: the description and tags below were written by an AI model that read this project's README and public documentation pages; stars, license and language come straight from the GitHub API. The model does not read the source code._ 3,401 stars · 120 forks · C++ · Apache-2.0 · archived ## Links - GitHub: https://github.com/google/cdc-file-transfer - awesome-repositories: https://awesome-repositories.com/repository/google-cdc-file-transfer.md ## Description Cdc-file-transfer is a file synchronization and transfer tool that calculates delta changes using content-defined chunking to transmit only modified segments across systems. It operates as a command line utility designed to sync and stream files between Windows and Linux operating system environments. The software splits files into variable-length blocks based on content patterns rather than fixed offsets to identify matching segments despite insertions or deletions. It isolates operating-system-specific file system APIs behind unified interfaces and calculates modified chunk hashes and missing byte ranges to minimize network bandwidth during updates. Additional capabilities include recursive directory tree synchronization, local block caching to store fetched remote chunks, and virtual file system mounting that exposes remote storage locations as local directory trees by intercepting system calls and fetching data dynamically on demand. ## Tags ### DevOps & Infrastructure - [Remote File System Mounts](https://awesome-repositories.com/f/devops-infrastructure/remote-file-system-mounts.md) — Exposes remote storage locations as local directory trees by intercepting system calls and fetching data dynamically on demand. - [Delta Synchronization](https://awesome-repositories.com/f/devops-infrastructure/remote-file-synchronization/delta-synchronization.md) — Transfers modified files between systems by calculating differences using content-defined chunking to accelerate updates. ([source](https://github.com/google/cdc-file-transfer/blob/main/README.md)) - [Remote Drive Mounts](https://awesome-repositories.com/f/devops-infrastructure/remote-file-system-mounts/development-directory-mappings/remote-drive-mounts.md) — Mounts remote directories locally to fetch file data on demand and cache reads for improved performance. ### Part of an Awesome List - [File Sync and Transfer](https://awesome-repositories.com/f/awesome-lists/devops/file-sync-and-transfer.md) — Transfers files and directories between systems recursively while skipping unchanged items and compressing data. ([source](https://github.com/google/cdc-file-transfer#readme)) ### Development Tools & Productivity - [Delta Compression Bandwidth Optimizations](https://awesome-repositories.com/f/development-tools-productivity/code-instrumentation-utilities/instrumented-file-caching/slow-conversion-caches/delta-compression-bandwidth-optimizations.md) — Calculates and transmits only modified chunk hashes and missing byte ranges to minimize network bandwidth during updates. - [Content-Defined Chunking](https://awesome-repositories.com/f/development-tools-productivity/content-addressable-stores/content-defined-chunking.md) — Splits files into variable-length blocks using content patterns to identify matching segments despite insertions or deletions. - [File Synchronizers](https://awesome-repositories.com/f/development-tools-productivity/content-addressable-stores/content-defined-chunking/file-synchronizers.md) — Provides a file synchronization tool that calculates delta changes using content-defined chunking to transmit only modified segments. - [Command-Line File Transfers](https://awesome-repositories.com/f/development-tools-productivity/remote-file-transfers/sftp-subsystems/command-line-file-transfers.md) — Provides a command line utility for syncing and streaming files between Windows and Linux operating system environments. ### Networking & Communication - [Cross-Platform File Synchronization](https://awesome-repositories.com/f/networking-communication/cross-platform-file-synchronization.md) — Synchronizes files and directories across different operating systems while compressing data and skipping unchanged items. - [Delta Transfer Protocols](https://awesome-repositories.com/f/networking-communication/delta-transfer-protocols.md) — Accelerates file updates between systems by detecting modified portions using content-defined chunking and transmitting differences. ### System Administration & Monitoring - [Recursive Directory Synchronization](https://awesome-repositories.com/f/system-administration-monitoring/recursive-directory-synchronization.md) — Walks directory hierarchies to compare metadata states across operating systems and selectively copy modified paths. ### Data & Databases - [On-Demand Remote](https://awesome-repositories.com/f/data-databases/database-management-systems/database-systems-management/database-systems/database-connections/on-demand-remote.md) — Makes remote directories immediately available as a read-only view and fetches requested file content on demand. ([source](https://github.com/google/cdc-file-transfer#readme)) - [Local Caching Layers](https://awesome-repositories.com/f/data-databases/local-first-storage/local-caching-layers.md) — Stores fetched remote chunks in a local persistence layer to accelerate subsequent read requests and minimize round trips. - [Remote Data Streaming](https://awesome-repositories.com/f/data-databases/remote-data-streaming.md) — Supports mounting and accessing remote directories locally by fetching file data dynamically and caching reads. ([source](https://github.com/google/cdc-file-transfer/blob/main/README.md)) ### Operating Systems & Systems Programming - [Cross-Platform File Operations](https://awesome-repositories.com/f/operating-systems-systems-programming/system-administration-maintenance/file-system-management/file-system-utilities/cross-platform-file-operations.md) — Copies files between different operating system environments using specialized command line tools. ([source](https://github.com/google/cdc-file-transfer/tree/main/tools)) ### Software Engineering & Architecture - [Cross-Platform Abstraction Layers](https://awesome-repositories.com/f/software-engineering-architecture/software-architecture/architectural-patterns/abstraction-domain-modeling/cross-platform-abstraction-layers.md) — Isolates operating-system-specific file system APIs behind unified interfaces for seamless cross-platform execution.