2 dépôts
Awesome GitHub RepositoriesMultithreaded Workload Partitioning
Distributes data processing tasks across multiple CPU cores to accelerate operations on large files.
Distinct from Data Partitioning: Distinct from Data Partitioning: focuses on CPU-level parallelization for performance rather than node-level sharding for storage.
Explore 2 awesome GitHub repositories matching data & databases · Multithreaded Workload Partitioning. Refine with filters or upvote what's useful.
Awesome Multithreaded Workload Partitioning GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- uxlfoundation/onetbb
uxlfoundation/oneTBB
6,678Voir sur GitHuboneAPI Threading Building Blocks (oneTBB)
Splits large data sets into smaller blocks and processes each block on a separate thread.
C++composabilityflowgraphheterogeneousprogramming - dathere/qsv
dathere/qsv
3,687Voir sur GitHubqsv is a high-performance command line toolkit for querying, transforming, and analyzing comma-separated value files. It functions as a data wrangling interface and a tabular data profiler, featuring a query engine capable of executing SQL statements and joins directly on flat files without requiring a database. The project is distinguished by its ability to process massive datasets that exceed available system memory. This is achieved through disk-based external memory processing, including multithreaded merge sorting, on-disk hash tables for deduplication, and lightweight file indexing for
Distributes heavy workloads across multiple CPU cores to accelerate search, join, and validation operations.
Rustaickancsv
