1 repo
Awesome GitHub RepositoriesStream-Based Data Pipelines
Processing architectures that pipe data directly to storage to optimize memory usage.
Distinguishing note: Focuses on disk writing streams rather than general data processing.
Explore 1 awesome GitHub repository matching data & databases · Stream-Based Data Pipelines. Refine with filters or upvote what's useful.
Awesome Stream-Based Data Pipelines GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- balena-io/etcher
balena-io/etcher
33,146View on GitHubEtcher is a cross-platform utility designed for creating bootable media by flashing raw disk images onto USB drives and SD cards. It functions as a desktop application that provides a graphical interface for low-level storage device management, ensuring data integrity through built-in validation during the writing process. The application utilizes a unified interface layer to map high-level commands to native system utilities, allowing it to operate consistently across different operating systems. It employs a stream-based data pipeline to pipe image contents directly to storage media, which
Pipes image file contents directly to storage media to minimize memory usage during large write operations.
TypeScriptcross-platformetchersd-cards
