Awesome GitHub RepositoriesParallel Command Execution

Lefthook 是一个 Git 钩子（hook）管理器和工作流自动化工具，使用配置驱动的方法来管理由版本控制事件触发的脚本。它充当并行任务运行器，同时执行多个脚本，以减少预提交（pre-commit）或预推送（pre-push）检查所需的时间。 该项目提供了一个容器化的钩子运行器，以确保不同开发者机器之间依赖项和工具集的一致性。它还支持通过在特定子目录中执行脚本和管理复杂的项目结构来进行 Monorepo 编排。 该系统包括基于模式的文件过滤功能，仅对修改后的资产运行质量保证任务。它还支持手动任务执行、命令标记和分组，以及针对特定环境设置的本地配置覆盖。

Lefthook is a Git hook manager and workflow automation tool designed to execute user-defined scripts during version control events. It automates the execution of linters, tests, and formatters to validate changes and maintain code quality before commits or pushes. The project distinguishes itself through a parallel execution model that runs multiple shell commands concurrently to reduce latency. It supports complex configuration management, including the ability to merge global, remote, and local settings and synchronize configurations from external repositories to standardize development env

k3sup is a command-line tool that installs and manages lightweight Kubernetes clusters entirely over SSH, without requiring any pre-installed software on the target machines. It bootstraps clusters on remote hosts using a single statically-linked binary, then provides immediate kubectl access by fetching and merging the cluster's admin credentials into the local configuration. The tool supports plan-driven cluster topology, allowing users to define node roles and configuration in a YAML file for automated multi-node deployment. The tool distinguishes itself by enabling parallel execution of i

Pixie is an open-source observability platform for Kubernetes that uses eBPF to automatically capture telemetry data from clusters without requiring any manual instrumentation or code changes. It functions as an eBPF telemetry collector, a continuous application profiler, a network traffic analyzer, and a scriptable telemetry query engine, all within a single Kubernetes-native tool. The platform distinguishes itself through several integrated capabilities. It continuously samples stack traces from compiled-language code to identify CPU performance bottlenecks, visualizing the results as inter

This is a GitHub Action that executes shell commands on remote servers over SSH as part of a CI/CD pipeline. It supports authentication using passwords, private keys, or private keys with passphrases, and can verify the SHA256 fingerprint of the remote host's public key before connecting to prevent man-in-the-middle attacks. The action can connect to multiple remote hosts in a single workflow step, optionally executing commands synchronously across all of them. It also supports routing SSH connections through an intermediate jump host to reach target servers in restricted networks. Environmen

Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g

ffmpeg-kit is a cross-platform SDK that wraps FFmpeg and FFprobe into native libraries for Android, iOS, macOS, Linux, and tvOS, enabling applications to execute media processing commands through platform-specific APIs. It provides a concurrent command executor that runs multiple FFmpeg operations simultaneously and collects results independently via thread-safe interfaces. The project includes a build system that compiles FFmpeg native libraries from source with configurable codec and library options for each target platform, and offers eight precompiled binary packages with different sets o

pyinfra is an agentless infrastructure automation framework that turns declarative Python code into idempotent shell commands to manage servers, containers, and local machines over SSH without requiring any pre-installed software on target hosts. It operates by comparing the desired state of a system against its current state, using a dry-run simulation mode to preview changes and a fact-based conditional execution engine to gather host attributes at runtime and control which operations run. The tool compiles Python operations into optimized shell commands and executes them in parallel across

pyinfra is a Python-based infrastructure automation framework that turns Python code into shell commands for managing servers, Docker containers, and local machines. It operates as a declarative, idempotent deployment tool, applying desired system states by comparing target configurations against current states and making only the necessary changes. The framework provides a connector-based transport abstraction that unifies SSH, Docker, and local execution behind a common interface, with a parallel execution engine that manages concurrent operations across hosts. The tool distinguishes itself

Axiom 是一个云基础设施编排器和分布式安全扫描框架。它作为一个管理器，用于跨多个云提供商和区域部署、快照和销毁一次性虚拟机集群。 该项目通过自动化在这些远程服务器上配置漏洞工具集和安全审计软件而脱颖而出。它具有一种通过在实例集群中分片目标列表并将结果数据聚合到统一文件和 HTML 报告中来分发安全扫描的机制。 该系统涵盖了广泛的操作能力，包括远程命令执行、并行文件传输以及针对高并发工作负载的内核级网络调优。它还提供用于图像快照管理、用于网络流量的 SSH 隧道以及部署预定义基础设施配置文件的工具。

Mgmt 是一个分布式配置管理系统，使用事件驱动自动化和闭环反馈来维护集群的预期状态。它作为一个基础设施自动化引擎，根据资源监控和预定义规范实时触发系统状态校正。 该系统包括一个分布式集群节点选择器，用于根据特定策略和约束选择主机子集以分配工作负载。它还具有一个云基础设施管理器，用于控制虚拟机实例的生命周期（包括镜像部署、区域选择和启动脚本），以及一个用于在基板管理控制器上安装和验证二进制文件的硬件固件编排器。 其他功能涵盖并行任务执行、基于透镜的配置文件修改和系统元数据检索。该工具集还提供用于数据类型转换、格式解码和环境检查以确定当前系统状态的实用程序。

GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la

s5cmd is a command line interface for high-performance data transfers and management tasks across S3 compatible storage services. It functions as a parallel data transfer tool and bucket synchronization utility, designed to accelerate the uploading and downloading of large volumes of files using concurrent workers. The tool acts as a batch command processor capable of executing thousands of object management operations in parallel from command files or piped streams. It also serves as an S3 Select query client, allowing the execution of SQL expressions against stored JSON records to retrieve

This project is a parallel test runner and shell command executor designed to reduce total runtime by executing test suites across multiple CPU cores. It functions as a test suite load balancer and a CI test process manager that coordinates global setup, teardown, and exit codes for continuous integration pipelines. The tool acts as a test database orchestrator by creating and managing unique database instances mapped to parallel processes, which prevents data collisions. It distributes tests into balanced groups based on file size or recorded runtimes to optimize execution time and avoid bot