Awesome GitHub RepositoriesParallel Command Execution

Lefthook ist ein Git-Hook-Manager und Workflow-Automatisierer, der einen konfigurationsgesteuerten Ansatz verwendet, um Skripte zu verwalten, die durch Versionskontrollereignisse ausgelöst werden. Es fungiert als paralleler Task-Runner, der mehrere Skripte gleichzeitig ausführt, um die für Pre-Commit- oder Pre-Push-Prüfungen erforderliche Zeit zu reduzieren. Das Projekt bietet einen containerisierten Hook-Runner, um konsistente Abhängigkeiten und Toolsets auf verschiedenen Entwicklerrechnern sicherzustellen. Es unterstützt zudem die Monorepo-Orchestrierung durch die Ausführung von Skripten in spezifischen Unterverzeichnissen und die Verwaltung komplexer Projektstrukturen. Das System umfasst Funktionen für musterbasiertes Dateifiltern, um Qualitätssicherungsaufgaben nur auf geänderte Assets anzuwenden. Es unterstützt zudem die manuelle Aufgabenausführung, das Tagging und Gruppieren von Befehlen sowie lokale Konfigurations-Overrides für umgebungsspezifische Einstellungen.

Lefthook is a Git hook manager and workflow automation tool designed to execute user-defined scripts during version control events. It automates the execution of linters, tests, and formatters to validate changes and maintain code quality before commits or pushes. The project distinguishes itself through a parallel execution model that runs multiple shell commands concurrently to reduce latency. It supports complex configuration management, including the ability to merge global, remote, and local settings and synchronize configurations from external repositories to standardize development env

k3sup is a command-line tool that installs and manages lightweight Kubernetes clusters entirely over SSH, without requiring any pre-installed software on the target machines. It bootstraps clusters on remote hosts using a single statically-linked binary, then provides immediate kubectl access by fetching and merging the cluster's admin credentials into the local configuration. The tool supports plan-driven cluster topology, allowing users to define node roles and configuration in a YAML file for automated multi-node deployment. The tool distinguishes itself by enabling parallel execution of i

Pixie is an open-source observability platform for Kubernetes that uses eBPF to automatically capture telemetry data from clusters without requiring any manual instrumentation or code changes. It functions as an eBPF telemetry collector, a continuous application profiler, a network traffic analyzer, and a scriptable telemetry query engine, all within a single Kubernetes-native tool. The platform distinguishes itself through several integrated capabilities. It continuously samples stack traces from compiled-language code to identify CPU performance bottlenecks, visualizing the results as inter

This is a GitHub Action that executes shell commands on remote servers over SSH as part of a CI/CD pipeline. It supports authentication using passwords, private keys, or private keys with passphrases, and can verify the SHA256 fingerprint of the remote host's public key before connecting to prevent man-in-the-middle attacks. The action can connect to multiple remote hosts in a single workflow step, optionally executing commands synchronously across all of them. It also supports routing SSH connections through an intermediate jump host to reach target servers in restricted networks. Environmen

Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g

ffmpeg-kit is a cross-platform SDK that wraps FFmpeg and FFprobe into native libraries for Android, iOS, macOS, Linux, and tvOS, enabling applications to execute media processing commands through platform-specific APIs. It provides a concurrent command executor that runs multiple FFmpeg operations simultaneously and collects results independently via thread-safe interfaces. The project includes a build system that compiles FFmpeg native libraries from source with configurable codec and library options for each target platform, and offers eight precompiled binary packages with different sets o

pyinfra is an agentless infrastructure automation framework that turns declarative Python code into idempotent shell commands to manage servers, containers, and local machines over SSH without requiring any pre-installed software on target hosts. It operates by comparing the desired state of a system against its current state, using a dry-run simulation mode to preview changes and a fact-based conditional execution engine to gather host attributes at runtime and control which operations run. The tool compiles Python operations into optimized shell commands and executes them in parallel across

pyinfra is a Python-based infrastructure automation framework that turns Python code into shell commands for managing servers, Docker containers, and local machines. It operates as a declarative, idempotent deployment tool, applying desired system states by comparing target configurations against current states and making only the necessary changes. The framework provides a connector-based transport abstraction that unifies SSH, Docker, and local execution behind a common interface, with a parallel execution engine that manages concurrent operations across hosts. The tool distinguishes itself

Axiom is a cloud infrastructure orchestrator and distributed security scanning framework. It serves as a manager for deploying, snapshotting, and destroying disposable virtual machine fleets across multiple cloud providers and regions. The project distinguishes itself by automating the provisioning of vulnerability toolsets and security auditing software across these remote servers. It features a mechanism for distributing security scans by sharding target lists across a fleet of instances and aggregating the resulting data into unified files and HTML reports. The system covers a broad range

Mgmt ist ein verteiltes Konfigurationsmanagementsystem, das den gewünschten Zustand von Clustern mittels ereignisgesteuerter Automatisierung und Closed-Loop-Feedback aufrechterhält. Es fungiert als Infrastruktur-Automatisierungs-Engine, die Systemzustandskorrekturen in Echtzeit basierend auf Ressourcenüberwachung und vordefinierten Spezifikationen auslöst. Das System enthält einen verteilten Cluster-Node-Selektor für die Wahl von Teilmengen von Hosts basierend auf spezifischen Strategien und Einschränkungen, um Workloads zu verteilen. Es verfügt zudem über einen Cloud-Infrastruktur-Manager für die Steuerung des Lebenszyklus von virtuellen Maschineninstanzen, einschließlich Image-Deployment, Regionsauswahl und Startup-Skripten, ergänzt durch einen Hardware-Firmware-Orchestrator für die Installation und Verifizierung von Binärdateien auf Baseboard-Management-Controllern. Zusätzliche Funktionen decken parallele Task-Ausführung, lens-basierte Konfigurationsdateimodifikation und System-Metadatenabruf ab. Das Toolset bietet zudem Dienstprogramme für Datentyp-Transformation, Format-Dekodierung und Umgebungsinspektion, um aktuelle Systemzustände zu bestimmen.

GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la

s5cmd is a command line interface for high-performance data transfers and management tasks across S3 compatible storage services. It functions as a parallel data transfer tool and bucket synchronization utility, designed to accelerate the uploading and downloading of large volumes of files using concurrent workers. The tool acts as a batch command processor capable of executing thousands of object management operations in parallel from command files or piped streams. It also serves as an S3 Select query client, allowing the execution of SQL expressions against stored JSON records to retrieve

This project is a parallel test runner and shell command executor designed to reduce total runtime by executing test suites across multiple CPU cores. It functions as a test suite load balancer and a CI test process manager that coordinates global setup, teardown, and exit codes for continuous integration pipelines. The tool acts as a test database orchestrator by creating and managing unique database instances mapped to parallel processes, which prevents data collisions. It distributes tests into balanced groups based on file size or recorded runtimes to optimize execution time and avoid bot