mozilla/sccache
Sccache
sccache is a compiler cache wrapper and distributed compilation cache designed to store and reuse compilation results. It functions as a specialized caching solution for the Rust compiler, as well as a general tool to avoid redundant build cycles and reduce total build time.
The project distinguishes itself through a cloud-backed build cache and remote storage backends. It enables the synchronization of build artifacts across multiple machines or team members using distributed memory caches or cloud object storage.
Supported storage backends include local file systems, WebDAV, and a wide array of cloud providers such as S3-compatible storage, Azure Blob, Google Cloud Storage, Alibaba OSS, and Tencent Cloud COS. High-performance remote options include Redis and Memcached. The system also integrates with GitHub Actions for CI pipeline optimization and utilizes cloud identity authentication to secure access to remote storage.
The tool manages build acceleration through path normalization, hierarchical cache layering, and content-addressable hashing to ensure cache consistency across different environments.
Features
- Compiler Caches - Reduces total build time by storing and reusing compilation results on local or remote storage.
- Compiler Wrappers - Functions as a compiler wrapper that intercepts calls to check for cached artifacts before executing the build.
- Cloud Object Storage - Integrates with S3, Azure, and Google Cloud buckets to provide persistent remote storage for shared compilation data.
- Build Artifact Caching - Persists build artifacts in cloud storage like S3, Redis, or Memcached to share results across machines.
- Distributed Build Systems - Shares build tasks across a network of clients and servers to accelerate compilation through parallel execution.
- Remote Build Caches - Shares cached compilation artifacts across multiple machines and team members using remote backends.
- Build Output Caches - Implements a system that stores and reuses compiler outputs to accelerate repeated Rust build processes.
- Rust Environments - Accelerates the Rust build process by caching module interfaces and object files.
- Compiler Caching for Rust - Provides a specialized caching solution to speed up the compilation of Rust modules and object files.
- Build Result Caching - Stores and reuses compilation results on local or remote storage to eliminate redundant build cycles.
- Path Normalizers - Transforms absolute file paths into relative formats to ensure cache hits across different environments.
- Content-Addressable Caches - Uses content-addressable hashing of command-line arguments and files to identify and retrieve build artifacts.
- Cache Configuration Utilities - Configures storage backends in a tiered hierarchy from fastest to slowest to maximize hit rates.
- Preprocessing Caches - Caches the results of the source file preprocessing phase to speed up the retrieval of final compilation results.
- Cache Isolations - Prevents different compilation runs from sharing the same cache by incorporating unique values into result hashes.
- Build Server Management - Manages server processes that handle compilation requests via shared persistent services or isolated instances.
- Multi-Layered Caching - Organizes storage backends in a hierarchy from fastest to slowest to optimize cache retrieval speed.
- CI Pipeline Optimizers - Optimizes automated CI environments by persisting build artifacts between different workflow runs.
- Storage Backend Integrations - Provides a flexible storage interface integrating WebDAV and cloud providers to store precompiled artifacts.
- Module Caching - Stores precompiled C++20 module interfaces and object files to avoid redundant module compilation.
- GitHub Actions - Provides a specialized backend to store and purge compilation results within GitHub Actions workflows.
- Storage Abstractions - Implements a common interface to decouple caching logic from various local and remote storage providers.
- Caching and Memoization - Shared compilation cache for build acceleration.
- Databases & Data - Shared compilation cache for faster builds.
- बिल्ड सिस्टम - Compiler cache with cloud storage support.
