Awesome GitHub RepositoriesDevOps Tools

Ansible is an agentless infrastructure automation engine designed to manage remote servers and network devices. It functions as a cross-platform orchestration tool that coordinates system updates, software installations, and service configurations from a centralized management workstation. By utilizing a declarative approach, it allows users to define desired system states through human-readable configuration files, ensuring consistency across distributed environments. The platform operates by establishing secure shell connections to target nodes, eliminating the need for persistent agent sof

The AWS Command Line Interface is a terminal tool and API client used to manage and automate Amazon Web Services infrastructure. It functions as a cloud resource management tool that allows for the creation, configuration, and modification of cloud services through a unified set of commands. The tool provides mechanisms to route authenticated requests to global and region-specific service endpoints. It manages identity keys and access profiles through environment variables and configuration files to authenticate requests across different cloud accounts. The interface supports cloud resource

Fabric is a command-line interface and framework designed to integrate artificial intelligence reasoning into shell-based workflows. It functions as an orchestration tool that connects local data pipelines to remote artificial intelligence services, allowing users to automate content analysis and complex reasoning tasks directly from the terminal. The project distinguishes itself through a modular architecture that treats prompt patterns as version-controlled, reusable logic stored on the local filesystem. By utilizing standard input and output streams, it enables users to chain these analyti

Salt is an infrastructure configuration management tool and orchestration framework designed for large-scale system administration. It functions as a remote execution engine that enables administrators to manage, provision, and enforce declarative states across distributed fleets of servers from a central control point. By utilizing a high-performance message bus, the platform allows for the simultaneous execution of administrative tasks and the maintenance of consistent software configurations across thousands of nodes. The system distinguishes itself through a flexible architecture that sup

Pre-commit is a framework for managing and executing automated tasks during the version control commit process. It functions as a configuration-driven utility that enforces project standards by running linters, formatters, and security scanners on staged files before they are committed to a repository. The system uses a centralized manifest to orchestrate these tasks, ensuring consistent developer tooling across teams. It distinguishes itself by provisioning isolated environments for each tool, which prevents dependency conflicts and ensures that all required versions are present. The framewo

Logstash is a JVM-based event processor and extract, transform, load system designed for log data processing pipelines. It functions as a plugin-based data ingestor that collects, transforms, and delivers logs and event data from multiple sources to various destinations. The system utilizes a modular architecture of interchangeable input, filter, and output components to handle real-time data ingestion and enterprise log aggregation. Users can extend the pipeline's functionality by developing custom plugins to support unique data sources or specific transformation logic. The platform covers

Kamal is a deployment tool for containerized applications that manages Docker containers across a fleet of remote servers via SSH. It serves as a lightweight alternative to managed platforms, enabling the hosting of web applications on bare metal or virtual private servers without a heavy orchestrator. The tool orchestrates zero-downtime deployments by managing container rotations and using traffic switching to ensure applications remain available during updates. It utilizes a centralized command line interface to coordinate deployment sequences and execute commands across multiple remote des

Borg est un utilitaire de sauvegarde en ligne de commande conçu pour l'archivage de données dédupliquées et le stockage sécurisé. Il fonctionne en identifiant des blocs de fichiers uniques et en appliquant une compression pour minimiser l'empreinte de stockage totale sur plusieurs versions de sauvegarde. Le logiciel se distingue par l'utilisation d'un chiffrement authentifié, qui garantit que toutes les données stockées restent confidentielles et protégées contre toute altération non autorisée. Il fournit également une interface de système de fichiers virtuel, permettant aux utilisateurs de monter des archives comme des répertoires locaux pour parcourir et accéder à des fichiers individuels sans effectuer une restauration complète du jeu de données. Le système gère ces archives via l'indexation des métadonnées au niveau du dépôt et le découpage défini par le contenu, qui utilise des algorithmes de hachage glissant pour détecter et stocker uniquement les segments de données uniques. Ces capacités sont soutenues par une compression basée sur les flux pour optimiser à la fois les besoins de stockage et les vitesses de transfert réseau.

Cette bibliothèque fournit une interface programmatique pour surveiller les ressources système et gérer les cycles de vie des processus. Elle fonctionne comme un utilitaire multiplateforme qui récupère des métriques en temps réel sur l'utilisation du matériel et permet l'inspection et le contrôle des processus système en cours d'exécution. Le projet normalise les structures de données disparates des systèmes d'exploitation dans une interface unifiée, permettant une interaction cohérente avec les informations au niveau du noyau, quel que soit l'environnement hôte. En utilisant des extensions compilées pour s'interfacer directement avec les API système natives, elle fournit un moyen cohérent d'accéder aux données de performance et de gérer les états des tâches qui nécessiteraient autrement des utilitaires en ligne de commande spécifiques à la plateforme. La bibliothèque couvre un large éventail de tâches d'administration système et de profilage de performance, y compris la collecte de données granulaires sur les processeurs, la mémoire, les disques et les interfaces réseau. Elle est conçue pour être intégrée dans des scripts afin d'automatiser la surveillance de la santé du matériel et la gestion de la stabilité des applications.

Chalice is a framework for building and deploying serverless applications and REST APIs on AWS Lambda using Python. It functions as an infrastructure-as-code generator, mapping application logic and routing definitions directly to cloud compute resources while automating the provisioning and management of the underlying environment. The framework distinguishes itself by analyzing source code to automatically construct the minimum necessary security permissions, ensuring least-privilege access for all deployed functions. It supports modular development through blueprint-based organization and

Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain

Supervisor is a process control system for Unix environments that ensures background processes remain running by automatically restarting them if they crash or exit. It functions as a daemon manager that provides a centralized way to start, stop, and monitor the lifecycle of long-running background tasks. The system utilizes a client-server architecture to control multiple processes through a command line interface. This allows for the orchestration of system services and background daemon control without requiring manual shell intervention. The tool covers application process supervision an

Chef is a configuration management platform and infrastructure as code framework used to automate the deployment and maintenance of infrastructure state across a fleet of servers. It operates as an idempotent automation engine, ensuring systems converge to a desired state by applying only the necessary changes to resolve differences. The system functions as a multi-platform server orchestrator capable of managing infrastructure across different operating systems, cloud providers, and hardware architectures. It includes a dedicated infrastructure testing framework to verify configuration code

Puppet is an infrastructure as code tool and configuration management framework used to automate the provisioning and state orchestration of server fleets. It functions as a declarative state orchestrator that manages server configurations and system settings to ensure consistency and reproducibility across a fleet of machines. The system utilizes a declarative state modeling approach and an idempotent execution engine to maintain configuration state and prevent environment drift. It employs resource-based abstraction and a client-server architecture to translate high-level specifications int

sh is a Python process management library that provides programmatic wrappers and interfaces for controlling Unix system commands and child process lifecycles. It functions as an asynchronous process wrapper, allowing shell commands and system programs to run within a non-blocking event loop. The library maps command-line arguments and standard input/output streams to native Python functions and objects. It includes a process lifecycle controller to manage signal groups, execution timeouts, and process permissions for spawned child processes. The project provides capabilities for executable

OpenStack is an open-source cloud computing platform for building and managing public and private cloud infrastructure at scale. It provides a framework for deploying, configuring, and operating cloud services, orchestrating compute, storage, and networking resources across a datacenter through a unified management layer. The platform is built on a decoupled service architecture where individual cloud services are developed and versioned independently within their own repositories. This meta-repository tracks interoperable versions of all OpenStack components as verified submodules, with each

pyinfra is a Python-based infrastructure automation framework that turns Python code into shell commands for managing servers, Docker containers, and local machines. It operates as a declarative, idempotent deployment tool, applying desired system states by comparing target configurations against current states and making only the necessary changes. The framework provides a connector-based transport abstraction that unifies SSH, Docker, and local execution behind a common interface, with a parallel execution engine that manages concurrent operations across hosts. The tool distinguishes itself

Ce projet est un orchestrateur de sauvegarde Unix utilisé pour modéliser et exécuter la protection des données full-stack. Il fonctionne comme un système de gestion pour les dumps de base de données, l'archivage chiffré, la rotation des versions et le transport vers un stockage distant. Le système se distingue en orchestrant des outils système natifs pour diverses bases de données, incluant PostgreSQL, MySQL, MongoDB, Redis et Riak. Il emploie un workflow d'archivage sécurisé qui combine la compression et le chiffrement en utilisant GPG, OpenSSL ou AES avant de transporter les paquets vers des services compatibles S3, Dropbox ou des serveurs distants via SFTP et RSync. Les capacités étendues incluent l'automatisation de la synchronisation des données via des transferts delta et des téléchargements par blocs, ainsi qu'une gestion de rétention avec état pour faire pivoter et élaguer les archives historiques. L'orchestrateur dispose également d'un système de notification multicanal qui s'intègre avec l'email, HTTP POST, PagerDuty et diverses plateformes de chat pour alerter les administrateurs des résultats des opérations. Les utilisateurs peuvent définir ces workflows en utilisant un modèle basé sur la configuration qui prend en charge l'injection de variables dynamiques et la vérification de la syntaxe.

Mina est un outil de déploiement distant basé sur Git et d'automatisation SSH conçu pour gérer les releases d'applications. Il fonctionne comme un gestionnaire de versions basé sur des liens symboliques qui clone le code source depuis des dépôts Git directement sur les serveurs, et est spécifiquement conçu pour gérer le déploiement et la configuration d'environnements de projets Ruby. Le système automatise les mises à jour de serveur en générant un script bash unique localement et en l'exécutant via une session SSH unique. Cette approche permet des déploiements sans interruption (zero-downtime) en utilisant des répertoires de version horodatés et en mettant à jour un lien symbolique pour basculer instantanément entre les versions active et précédente. L'outil couvre un flux d'automatisation complet incluant l'exécution de commandes distantes, l'installation de dépendances et l'orchestration de tâches de build. Il fournit également des mécanismes de rollback de déploiement et de nettoyage automatique des versions pour maintenir un nombre configurable de builds récents.

Cloud-init is an automated server provisioning and instance initialization tool designed to configure virtual machines during the early boot process. It functions as a metadata provisioner that retrieves instance configuration data from cloud providers to set up network, storage, and user settings. The project provides a cross-distribution boot configuration layer that applies consistent system settings across different Linux distributions. It utilizes a modular provider abstraction to handle API differences between various cloud platforms and employs a staged boot execution model to ensure i