6 repository-uri
Task distribution mechanisms that allow idle threads to claim pending tasks from busy threads.
Distinct from Task Queues: Distinct from general task queues: focuses on the work-stealing load-balancing algorithm.
Explore 6 awesome GitHub repositories matching software engineering & architecture · Work-Stealing Queues. Refine with filters or upvote what's useful.
Taskflow is a C++ task-parallel framework designed to build high-performance parallel workflows and complex dependency graphs. It provides a programming model that organizes computational work into directed acyclic graphs, enabling developers to manage concurrency, resource scheduling, and task dependencies across multi-core CPUs and GPU accelerators. The framework distinguishes itself through its ability to orchestrate heterogeneous systems, allowing for the integration of hardware-accelerated kernels and memory operations into unified execution pipelines. It supports dynamic runtime subflow
Allocates work-stealing queues to store and distribute parallel tasks across multiple threads for efficient load balancing.
HVM2 is a high-performance execution environment for pure functional programs, implemented as a systems-level runtime in Rust. It functions as a massively parallel functional runtime that uses interaction combinators to achieve automatic parallelism across multi-core CPUs and GPUs. The project distinguishes itself by using a graph-rewriting computational model to execute programs via local reduction rules, which eliminates the need for manual locks or atomic operations. It employs beta-optimal reduction and lazy evaluation to optimize higher-order functions and eliminate redundant computation
Distributes the computation of expressions across a pool of threads using a work-stealing queue to maximize hardware utilization.
Crossbeam is a concurrency toolkit for Rust providing low-level primitives for writing multi-threaded programs. It focuses on lock-free data structures and memory management primitives designed for shared-memory concurrent environments. The project includes a work-stealing scheduler that uses double-ended queues to balance workloads across multiple processor cores. This system enables the implementation of work-stealing deques to distribute tasks and prevent bottlenecks. The toolkit covers broader capabilities for parallel algorithm development, multi-threaded task scheduling, and general co
Provides work-stealing deques that allow idle threads to steal tasks from busy workers.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Implements a first-in-first-out queue that allows cluster members and clients to enqueue and dequeue serializable objects across a network.
async-std este un runtime asincron Rust și o bibliotecă de I/O non-blocantă. Servește drept bibliotecă standard asincronă, oferind un set de alternative la biblioteca principală Rust pentru gestionarea sarcinilor concurente, a rețelelor și a accesului la sistemul de fișiere. Proiectul implementează un API oglindit după biblioteca standard, oferind versiuni asincrone ale tipurilor sincrone existente pentru a menține o interfață familiară. Această abordare permite dezvoltarea asincronă în Rust folosind o interfață care reflectă ergonomia bibliotecii standard a limbajului. Runtime-ul include un executor de sarcini pentru programarea și executarea operațiunilor asincrone pe mai multe fire de execuție. Suprafața sa de capabilități acoperă execuția sarcinilor concurente, operațiuni de intrare și ieșire non-blocante și gestionarea generală a runtime-ului.
Uses a work-stealing queue strategy to balance computational load across worker threads.
RavenDB is a multi-model NoSQL document database designed for high-performance, ACID-compliant data storage. It persists structured information as schema-flexible JSON documents and utilizes a unit-of-work session pattern to track entity changes and batch modifications into atomic transactions. The platform is built on a distributed architecture that supports horizontal scaling through sharding and ensures high availability via multi-node, master-to-master cluster replication. The database distinguishes itself through a self-optimizing query engine that automatically creates and maintains ind
Assigns background operational tasks to available nodes and automatically reassigns them if a node becomes unavailable.