14 مستودعات
Concurrent execution of multiple shell commands to reduce total workflow latency.
Distinguishing note: Shortlist focuses on script-specific runtimes (PHP, JS) or crawlers, not general parallel shell process management.
Explore 14 awesome GitHub repositories matching development tools & productivity · Parallel Command Execution. Refine with filters or upvote what's useful.
Lefthook هو مدير لـ Git hooks ومؤتمت لسير العمل يستخدم نهجاً قائماً على الإعدادات لإدارة النصوص التي يتم تشغيلها بواسطة أحداث التحكم في الإصدارات. يعمل كمنفذ مهام متوازٍ، حيث ينفذ نصوصاً متعددة في وقت واحد لتقليل الوقت المطلوب لفحوصات ما قبل الالتزام (pre-commit) أو ما قبل الدفع (pre-push). يوفر المشروع منفذ hooks حاوياً (containerized) لضمان اتساق التبعيات ومجموعات الأدوات عبر أجهزة المطورين المختلفة. كما يدعم تنظيم المستودعات المتعددة (monorepo) من خلال تنفيذ النصوص داخل أدلة فرعية محددة وإدارة هياكل المشاريع المعقدة. يتضمن النظام قدرات لتصفية الملفات القائمة على الأنماط لتشغيل مهام ضمان الجودة فقط على الأصول المعدلة. كما يدعم تنفيذ المهام اليدوي، ووسم المهام وتجميعها، وتجاوز الإعدادات المحلية للإعدادات الخاصة بالبيئة.
Provides concurrent execution of multiple shell commands to minimize the time spent waiting for git hook completion.
Lefthook is a Git hook manager and workflow automation tool designed to execute user-defined scripts during version control events. It automates the execution of linters, tests, and formatters to validate changes and maintain code quality before commits or pushes. The project distinguishes itself through a parallel execution model that runs multiple shell commands concurrently to reduce latency. It supports complex configuration management, including the ability to merge global, remote, and local settings and synchronize configurations from external repositories to standardize development env
Executes multiple commands and scripts concurrently to significantly reduce total execution time.
k3sup is a command-line tool that installs and manages lightweight Kubernetes clusters entirely over SSH, without requiring any pre-installed software on the target machines. It bootstraps clusters on remote hosts using a single statically-linked binary, then provides immediate kubectl access by fetching and merging the cluster's admin credentials into the local configuration. The tool supports plan-driven cluster topology, allowing users to define node roles and configuration in a YAML file for automated multi-node deployment. The tool distinguishes itself by enabling parallel execution of i
Runs installation and management commands concurrently across all specified hosts.
Pixie is an open-source observability platform for Kubernetes that uses eBPF to automatically capture telemetry data from clusters without requiring any manual instrumentation or code changes. It functions as an eBPF telemetry collector, a continuous application profiler, a network traffic analyzer, and a scriptable telemetry query engine, all within a single Kubernetes-native tool. The platform distinguishes itself through several integrated capabilities. It continuously samples stack traces from compiled-language code to identify CPU performance bottlenecks, visualizing the results as inter
Runs bpftrace scripts on all cluster nodes and makes the output queryable and visualizable in the UI.
This is a GitHub Action that executes shell commands on remote servers over SSH as part of a CI/CD pipeline. It supports authentication using passwords, private keys, or private keys with passphrases, and can verify the SHA256 fingerprint of the remote host's public key before connecting to prevent man-in-the-middle attacks. The action can connect to multiple remote hosts in a single workflow step, optionally executing commands synchronously across all of them. It also supports routing SSH connections through an intermediate jump host to reach target servers in restricted networks. Environmen
Connects to multiple remote hosts simultaneously and executes commands across all of them in one step.
Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g
Queues shell commands and runs them concurrently with configurable per-group parallelism limits.
ffmpeg-kit is a cross-platform SDK that wraps FFmpeg and FFprobe into native libraries for Android, iOS, macOS, Linux, and tvOS, enabling applications to execute media processing commands through platform-specific APIs. It provides a concurrent command executor that runs multiple FFmpeg operations simultaneously and collects results independently via thread-safe interfaces. The project includes a build system that compiles FFmpeg native libraries from source with configurable codec and library options for each target platform, and offers eight precompiled binary packages with different sets o
Runs multiple FFmpeg commands simultaneously and collects independent results per command via thread-safe APIs.
pyinfra is an agentless infrastructure automation framework that turns declarative Python code into idempotent shell commands to manage servers, containers, and local machines over SSH without requiring any pre-installed software on target hosts. It operates by comparing the desired state of a system against its current state, using a dry-run simulation mode to preview changes and a fact-based conditional execution engine to gather host attributes at runtime and control which operations run. The tool compiles Python operations into optimized shell commands and executes them in parallel across
Runs operations concurrently across thousands of hosts with configurable parallelism.
pyinfra is a Python-based infrastructure automation framework that turns Python code into shell commands for managing servers, Docker containers, and local machines. It operates as a declarative, idempotent deployment tool, applying desired system states by comparing target configurations against current states and making only the necessary changes. The framework provides a connector-based transport abstraction that unifies SSH, Docker, and local execution behind a common interface, with a parallel execution engine that manages concurrent operations across hosts. The tool distinguishes itself
Manages concurrent operation execution across hosts with configurable parallelism and serialization controls.
Axiom هو منسق للبنية التحتية السحابية وإطار عمل موزع للمسح الأمني. يعمل كمدير لنشر، وأخذ لقطات، وتدمير أساطيل الأجهزة الافتراضية القابلة للتخلص منها عبر مزودي سحابة ومناطق متعددة. يتميز المشروع بأتمتة توفير مجموعات أدوات الثغرات وبرمجيات التدقيق الأمني عبر هذه الخوادم البعيدة. يتميز بآلية لتوزيع عمليات المسح الأمني عن طريق تقسيم قوائم الأهداف عبر أسطول من المثيلات وتجميع البيانات الناتجة في ملفات موحدة وتقارير HTML. يغطي النظام مجموعة واسعة من الإمكانيات التشغيلية، بما في ذلك تنفيذ الأوامر عن بُعد، ونقل الملفات المتوازي، وضبط الشبكة على مستوى النواة لأحمال العمل ذات التزامن العالي. كما يوفر أدوات لإدارة لقطات الصور، وأنفاق SSH لحركة مرور الشبكة، ونشر ملفات تعريف البنية التحتية المحددة مسبقاً.
Runs a single command across all selected remote instances simultaneously in foreground or background processes.
Mgmt is a distributed configuration management system that maintains the desired state of clusters using event-driven automation and closed-loop feedback. It functions as an infrastructure automation engine that triggers system state corrections in real-time based on resource monitoring and predefined specifications. The system includes a distributed cluster node selector for electing subsets of hosts based on specific strategies and constraints to distribute workloads. It also features a cloud infrastructure manager for controlling the lifecycle of virtual machine instances, including image
Coordinates configuration tasks across multiple remote hosts concurrently from a single workflow step.
GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la
Implements parallel and threaded execution of command sequences defined in local files or cloud documents.
s5cmd is a command line interface for high-performance data transfers and management tasks across S3 compatible storage services. It functions as a parallel data transfer tool and bucket synchronization utility, designed to accelerate the uploading and downloading of large volumes of files using concurrent workers. The tool acts as a batch command processor capable of executing thousands of object management operations in parallel from command files or piped streams. It also serves as an S3 Select query client, allowing the execution of SQL expressions against stored JSON records to retrieve
Enables concurrent execution of thousands of object management tasks from command files or piped streams.
This project is a parallel test runner and shell command executor designed to reduce total runtime by executing test suites across multiple CPU cores. It functions as a test suite load balancer and a CI test process manager that coordinates global setup, teardown, and exit codes for continuous integration pipelines. The tool acts as a test database orchestrator by creating and managing unique database instances mapped to parallel processes, which prevents data collisions. It distributes tests into balanced groups based on file size or recorded runtimes to optimize execution time and avoid bot
Executes any shell command across multiple processes, assigning each a unique process identifier.