14 repository-uri
Concurrent execution of multiple shell commands to reduce total workflow latency.
Distinguishing note: Shortlist focuses on script-specific runtimes (PHP, JS) or crawlers, not general parallel shell process management.
Explore 14 awesome GitHub repositories matching development tools & productivity · Parallel Command Execution. Refine with filters or upvote what's useful.
Lefthook este un manager de Git hooks și un automatizator de flux de lucru care utilizează o abordare bazată pe configurare pentru a gestiona scripturile declanșate de evenimentele de control al versiunilor. Funcționează ca un runner de sarcini în paralel, executând mai multe scripturi simultan pentru a reduce timpul necesar pentru verificările pre-commit sau pre-push. Proiectul oferă un runner de hook-uri containerizat pentru a asigura dependențe și seturi de instrumente consistente pe diferite mașini de dezvoltare. De asemenea, suportă orchestrarea monorepo-urilor prin executarea scripturilor în subdirectoare specifice și gestionarea structurilor complexe de proiect. Sistemul include capabilități pentru filtrarea fișierelor bazată pe tipare, pentru a rula sarcini de asigurare a calității doar pe activele modificate. De asemenea, suportă executarea manuală a sarcinilor, etichetarea și gruparea comenzilor, precum și suprascrieri de configurare locală pentru setări specifice mediului.
Provides concurrent execution of multiple shell commands to minimize the time spent waiting for git hook completion.
Lefthook is a Git hook manager and workflow automation tool designed to execute user-defined scripts during version control events. It automates the execution of linters, tests, and formatters to validate changes and maintain code quality before commits or pushes. The project distinguishes itself through a parallel execution model that runs multiple shell commands concurrently to reduce latency. It supports complex configuration management, including the ability to merge global, remote, and local settings and synchronize configurations from external repositories to standardize development env
Executes multiple commands and scripts concurrently to significantly reduce total execution time.
k3sup is a command-line tool that installs and manages lightweight Kubernetes clusters entirely over SSH, without requiring any pre-installed software on the target machines. It bootstraps clusters on remote hosts using a single statically-linked binary, then provides immediate kubectl access by fetching and merging the cluster's admin credentials into the local configuration. The tool supports plan-driven cluster topology, allowing users to define node roles and configuration in a YAML file for automated multi-node deployment. The tool distinguishes itself by enabling parallel execution of i
Runs installation and management commands concurrently across all specified hosts.
Pixie is an open-source observability platform for Kubernetes that uses eBPF to automatically capture telemetry data from clusters without requiring any manual instrumentation or code changes. It functions as an eBPF telemetry collector, a continuous application profiler, a network traffic analyzer, and a scriptable telemetry query engine, all within a single Kubernetes-native tool. The platform distinguishes itself through several integrated capabilities. It continuously samples stack traces from compiled-language code to identify CPU performance bottlenecks, visualizing the results as inter
Runs bpftrace scripts on all cluster nodes and makes the output queryable and visualizable in the UI.
This is a GitHub Action that executes shell commands on remote servers over SSH as part of a CI/CD pipeline. It supports authentication using passwords, private keys, or private keys with passphrases, and can verify the SHA256 fingerprint of the remote host's public key before connecting to prevent man-in-the-middle attacks. The action can connect to multiple remote hosts in a single workflow step, optionally executing commands synchronously across all of them. It also supports routing SSH connections through an intermediate jump host to reach target servers in restricted networks. Environmen
Connects to multiple remote hosts simultaneously and executes commands across all of them in one step.
Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g
Queues shell commands and runs them concurrently with configurable per-group parallelism limits.
ffmpeg-kit is a cross-platform SDK that wraps FFmpeg and FFprobe into native libraries for Android, iOS, macOS, Linux, and tvOS, enabling applications to execute media processing commands through platform-specific APIs. It provides a concurrent command executor that runs multiple FFmpeg operations simultaneously and collects results independently via thread-safe interfaces. The project includes a build system that compiles FFmpeg native libraries from source with configurable codec and library options for each target platform, and offers eight precompiled binary packages with different sets o
Runs multiple FFmpeg commands simultaneously and collects independent results per command via thread-safe APIs.
pyinfra is an agentless infrastructure automation framework that turns declarative Python code into idempotent shell commands to manage servers, containers, and local machines over SSH without requiring any pre-installed software on target hosts. It operates by comparing the desired state of a system against its current state, using a dry-run simulation mode to preview changes and a fact-based conditional execution engine to gather host attributes at runtime and control which operations run. The tool compiles Python operations into optimized shell commands and executes them in parallel across
Runs operations concurrently across thousands of hosts with configurable parallelism.
pyinfra is a Python-based infrastructure automation framework that turns Python code into shell commands for managing servers, Docker containers, and local machines. It operates as a declarative, idempotent deployment tool, applying desired system states by comparing target configurations against current states and making only the necessary changes. The framework provides a connector-based transport abstraction that unifies SSH, Docker, and local execution behind a common interface, with a parallel execution engine that manages concurrent operations across hosts. The tool distinguishes itself
Manages concurrent operation execution across hosts with configurable parallelism and serialization controls.
Axiom este un orchestrator de infrastructură cloud și un framework distribuit de scanare de securitate. Servește ca manager pentru deployment-ul, snapshot-area și distrugerea flotelor de mașini virtuale temporare pe mai mulți furnizori cloud și regiuni. Proiectul se distinge prin automatizarea provisioning-ului de toolset-uri de vulnerabilități și software de audit de securitate pe aceste servere remote. Dispune de un mecanism pentru distribuirea scanărilor de securitate prin sharding-ul listelor țintă pe o flotă de instanțe și agregarea datelor rezultate în fișiere unificate și rapoarte HTML. Sistemul acoperă o gamă largă de capabilități operaționale, inclusiv execuția de comenzi remote, transferuri paralele de fișiere și tuning de rețea la nivel de kernel pentru workload-uri cu concurență ridicată. De asemenea, oferă instrumente pentru gestionarea snapshot-urilor de imagini, tunelare SSH pentru traficul de rețea și deployment-ul de profiluri de infrastructură predefinite.
Runs a single command across all selected remote instances simultaneously in foreground or background processes.
Mgmt este un sistem distribuit de gestionare a configurațiilor care menține starea dorită a clusterelor folosind automatizarea bazată pe evenimente și feedback-ul closed-loop. Funcționează ca un motor de automatizare a infrastructurii care declanșează corecții ale stării sistemului în timp real, pe baza monitorizării resurselor și a specificațiilor predefinite. Sistemul include un selector de noduri de cluster distribuit pentru alegerea subseturilor de gazde pe baza unor strategii și constrângeri specifice pentru a distribui sarcinile de lucru. Dispune, de asemenea, de un manager de infrastructură cloud pentru controlul ciclului de viață al instanțelor de mașini virtuale, inclusiv deployment-ul imaginilor, selecția regiunii și scripturile de startup, alături de un orchestrator de firmware hardware pentru instalarea și verificarea binarilor pe baseboard management controllers (BMC). Capabilitățile suplimentare acoperă execuția sarcinilor în paralel, modificarea fișierelor de configurare bazată pe lens și regăsirea metadatelor sistemului. Setul de instrumente oferă, de asemenea, utilitare pentru transformarea tipurilor de date, decodarea formatelor și inspecția mediului pentru a determina stările curente ale sistemului.
Coordinates configuration tasks across multiple remote hosts concurrently from a single workflow step.
GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la
Implements parallel and threaded execution of command sequences defined in local files or cloud documents.
s5cmd is a command line interface for high-performance data transfers and management tasks across S3 compatible storage services. It functions as a parallel data transfer tool and bucket synchronization utility, designed to accelerate the uploading and downloading of large volumes of files using concurrent workers. The tool acts as a batch command processor capable of executing thousands of object management operations in parallel from command files or piped streams. It also serves as an S3 Select query client, allowing the execution of SQL expressions against stored JSON records to retrieve
Enables concurrent execution of thousands of object management tasks from command files or piped streams.
This project is a parallel test runner and shell command executor designed to reduce total runtime by executing test suites across multiple CPU cores. It functions as a test suite load balancer and a CI test process manager that coordinates global setup, teardown, and exit codes for continuous integration pipelines. The tool acts as a test database orchestrator by creating and managing unique database instances mapped to parallel processes, which prevents data collisions. It distributes tests into balanced groups based on file size or recorded runtimes to optimize execution time and avoid bot
Executes any shell command across multiple processes, assigning each a unique process identifier.