1 repositorio
Systems that adjust concurrent write tasks based on historical volume to optimize file creation.
Distinct from Concurrent Write Optimizations: Distinct from general concurrent write optimizations: focuses on scaling tasks to prevent small file generation.
Explore 1 awesome GitHub repository matching data & databases · Write Task Scalers. Refine with filters or upvote what's useful.
Presto is a distributed SQL query engine designed for high-performance analytical processing across heterogeneous data sources. It functions as a data federation platform and massively parallel processing engine, allowing users to execute interactive queries against diverse storage systems without requiring data migration. By mapping remote metadata and structures to a unified relational namespace, it enables seamless cross-platform analysis through a standard SQL interface. The engine distinguishes itself through a pluggable connector architecture and a shared-nothing distributed processing
Adjusts the initial number of concurrent write tasks based on historical output volume to optimize file creation.