Rayon

Features

Parallel Data Iterators - Converts sequential data structures into parallel iterators to execute operations across multiple threads.
Parallel Iterators - Transforms sequential data structures into parallel iterators to partition work across multiple processor cores.
Parallel Processing - Provides parallel iterators and work-stealing algorithms to distribute data processing workloads across multiple CPU cores.
Data Parallelism Frameworks - Provides a framework for transforming sequential data structures into parallel iterators for concurrent processing.
Thread Pools - Provides a global thread pool for managing concurrent tasks and minimizing thread creation overhead.
Parallel Loop Transformers - Transforms standard sequential loops into parallel versions to process collection elements concurrently.
Scoped Synchronization - Ensures memory safety by guaranteeing all spawned parallel operations complete before the parent scope exits.
Work-Stealing Schedulers - Implements work-stealing scheduling to dynamically balance computational load across available processor cores.
Scoped Task Synchronization - Ensures memory safety by guaranteeing that all spawned parallel tasks complete before the parent scope finishes execution.
Parallel Processing Utilities - Offers a comprehensive library for converting sequential Rust iterators into parallel versions for multi-core execution.
Execution Scopes - Establishes controlled execution environments where all spawned operations must finish before the scope exits.
Task Queues - Uses lock-free atomic structures to exchange work items between threads for high-throughput task distribution.
Task Schedulers - Implements a work-stealing scheduler that dynamically balances tasks across a thread pool to maximize throughput.
Concurrent Task Runners - Provides primitives for orchestrating concurrent tasks within a managed scope to improve application performance.
Parallel Task Spawning - Spawns multiple operations within a shared scope to perform concurrent calculations and merge results.
Recursive Decomposers - Orchestrates complex, recursive task decomposition to process sub-tasks in parallel until reaching a sequential base case.
Custom Thread Pool Configurations - Supports the creation of isolated, custom thread pools to prevent resource contention during heavy workloads.
Parallel Execution - Executes multiple operations concurrently within a shared scope to improve overall processing speed.
Custom Parallel Task Execution - Divides complex workloads into smaller independent units of work that run concurrently within a managed scope.
Broadcast Operations - Enables the distribution of operations to every thread within a pool for uniform updates or data collection.
Asynchronous Task Queues - Submits independent operations to a global thread pool for asynchronous background execution.

Open-source alternatives to Rayon

Similar open-source projects, ranked by how many features they share with Rayon.

sourcegraph/conc
sourcegraph/conc
10,307View on GitHub
conc is a Go concurrency library and structured concurrency framework providing primitives for managing parallel tasks, mapping slices, and collecting results. It implements a system for spawning scoped tasks to ensure all child processes complete before their parent exits. The library includes a goroutine pool manager to limit active concurrent processes and a panic-safe task runner that catches panics in goroutines and propagates stack traces to the parent. It also provides a concurrent map-reduce tool for transforming data slices and processing streams in parallel while maintaining the ori
Goconcurrencygogolang
View on GitHub10,307
dask/dask
dask/dask
13,746View on GitHub
Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows from single machines to large clusters. It functions as a cluster resource manager that orchestrates computational logic by representing tasks and their dependencies as directed acyclic graphs. This architecture allows the system to automate the distribution of workloads across available hardware while managing complex execution requirements. The project distinguishes itself through a lazy evaluation engine that defers data operations until they are explicitly requested, enabl
Pythondasknumpypandas
View on GitHub13,746
rust-lang/book
rust-lang/book
17,930View on GitHub
The Rust Programming Language Book is the official technical guide and educational resource for the Rust language. It provides a comprehensive walkthrough of the language's design, focusing on its core identity as a systems programming language that enforces memory safety and high-performance execution without the need for a garbage collector. The project is distinguished by its focus on ownership, borrowing, and lifetime tracking, which allow the compiler to verify memory safety and thread safety at compile time. It covers the language's unique approach to zero-cost abstractions, including t
Rustbookmdbookrust
View on GitHub17,930
progschj/threadpool
progschj/ThreadPool
8,756View on GitHub
ThreadPool is a C++ thread management library designed to execute asynchronous tasks using a fixed number of background worker threads. It functions as a concurrent task executor that reduces the overhead associated with the repeated creation and destruction of threads. The library utilizes a synchronized queue to distribute workloads across multiple CPU cores and employs variadic templates to accept any callable function with arbitrary arguments. The system manages concurrency through mutex-protected shared state and condition-variable signaling to wake idle threads. It also provides a mech
C++
View on GitHub8,756

See all 30 alternatives to Rayon

rayon-rsrayon

Features

Open-source alternatives to Rayon

sourcegraph/conc

dask/dask

rust-lang/book

progschj/ThreadPool

Star history

Open-source alternatives to Rayon

sourcegraph/conc

dask/dask

rust-lang/book

progschj/ThreadPool