2 repository-uri
Capabilities for changing the execution order of tasks already in a queue by swapping positions.
Distinct from Task Queues: Distinct from Task Queues: focuses on reordering queued items rather than grouping or managing the queue itself.
Explore 2 awesome GitHub repositories matching devops & infrastructure · Queue Reordering. Refine with filters or upvote what's useful.
Dynamo is a distributed inference orchestration platform designed for large language models. It functions as a system to coordinate prefill and decode phases across GPU nodes, utilizing a multi-backend runtime adapter to connect engines like vLLM and TensorRT-LLM through a unified block-oriented memory interface. An OpenAI-compatible API server provides the frontend for integration with existing tools and clients. The project is distinguished by its disaggregated serving architecture, which separates prompt processing and token generation onto independent GPU pools to optimize throughput and
Controls request reordering in the router queue using policies like first-come or shortest-processing-time.
Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g
Swaps the positions of two queued or stashed tasks to change execution order.