Awesome GitHub RepositoriesDevOps Tools

Ansible is an agentless infrastructure automation engine designed to manage remote servers and network devices. It functions as a cross-platform orchestration tool that coordinates system updates, software installations, and service configurations from a centralized management workstation. By utilizing a declarative approach, it allows users to define desired system states through human-readable configuration files, ensuring consistency across distributed environments. The platform operates by establishing secure shell connections to target nodes, eliminating the need for persistent agent sof

The AWS Command Line Interface is a terminal tool and API client used to manage and automate Amazon Web Services infrastructure. It functions as a cloud resource management tool that allows for the creation, configuration, and modification of cloud services through a unified set of commands. The tool provides mechanisms to route authenticated requests to global and region-specific service endpoints. It manages identity keys and access profiles through environment variables and configuration files to authenticate requests across different cloud accounts. The interface supports cloud resource

Fabric is a command-line interface and framework designed to integrate artificial intelligence reasoning into shell-based workflows. It functions as an orchestration tool that connects local data pipelines to remote artificial intelligence services, allowing users to automate content analysis and complex reasoning tasks directly from the terminal. The project distinguishes itself through a modular architecture that treats prompt patterns as version-controlled, reusable logic stored on the local filesystem. By utilizing standard input and output streams, it enables users to chain these analyti

Salt is an infrastructure configuration management tool and orchestration framework designed for large-scale system administration. It functions as a remote execution engine that enables administrators to manage, provision, and enforce declarative states across distributed fleets of servers from a central control point. By utilizing a high-performance message bus, the platform allows for the simultaneous execution of administrative tasks and the maintenance of consistent software configurations across thousands of nodes. The system distinguishes itself through a flexible architecture that sup

Pre-commit is a framework for managing and executing automated tasks during the version control commit process. It functions as a configuration-driven utility that enforces project standards by running linters, formatters, and security scanners on staged files before they are committed to a repository. The system uses a centralized manifest to orchestrate these tasks, ensuring consistent developer tooling across teams. It distinguishes itself by provisioning isolated environments for each tool, which prevents dependency conflicts and ensures that all required versions are present. The framewo

Logstash is a JVM-based event processor and extract, transform, load system designed for log data processing pipelines. It functions as a plugin-based data ingestor that collects, transforms, and delivers logs and event data from multiple sources to various destinations. The system utilizes a modular architecture of interchangeable input, filter, and output components to handle real-time data ingestion and enterprise log aggregation. Users can extend the pipeline's functionality by developing custom plugins to support unique data sources or specific transformation logic. The platform covers

Kamal is a deployment tool for containerized applications that manages Docker containers across a fleet of remote servers via SSH. It serves as a lightweight alternative to managed platforms, enabling the hosting of web applications on bare metal or virtual private servers without a heavy orchestrator. The tool orchestrates zero-downtime deployments by managing container rotations and using traffic switching to ensure applications remain available during updates. It utilizes a centralized command line interface to coordinate deployment sequences and execute commands across multiple remote des

Borg este un utilitar de backup în linie de comandă conceput pentru arhivarea datelor deduplicate și stocarea securizată. Acesta funcționează prin identificarea fragmentelor unice de fișiere și aplicarea compresiei pentru a minimiza amprenta totală de stocare pe mai multe versiuni de backup. Software-ul se distinge prin utilizarea criptării autentificate, care asigură că toate datele stocate rămân confidențiale și protejate împotriva manipulării neautorizate. De asemenea, oferă o interfață de sistem de fișiere virtual, permițând utilizatorilor să monteze arhivele ca directoare locale pentru a naviga și accesa fișiere individuale fără a efectua o restaurare completă a setului de date. Sistemul gestionează aceste arhive prin indexarea metadatelor la nivel de depozit și fragmentarea definită de conținut, care utilizează algoritmi de hash rulant pentru a detecta și stoca doar segmentele de date unice. Aceste capacități sunt susținute de compresia bazată pe flux pentru a optimiza atât cerințele de stocare, cât și vitezele de transfer în rețea.

Această bibliotecă oferă o interfață programatică pentru monitorizarea resurselor sistemului și gestionarea ciclurilor de viață ale proceselor. Funcționează ca un utilitar multi-platformă care preia metrici în timp real privind utilizarea hardware-ului și permite inspecția și controlul proceselor de sistem care rulează. Proiectul normalizează structurile de date disparate ale sistemelor de operare într-o interfață unificată, permițând interacțiunea consistentă cu informațiile la nivel de kernel, indiferent de mediul gazdă. Prin utilizarea extensiilor compilate pentru a interfața direct cu API-urile native ale sistemului, acesta oferă o modalitate consistentă de a accesa datele de performanță și de a gestiona stările sarcinilor care, altfel, ar necesita utilitare de linie de comandă specifice platformei. Biblioteca acoperă o gamă largă de sarcini de administrare a sistemului și profilare a performanței, inclusiv colectarea de date granulare despre procesoare, memorie, discuri și interfețe de rețea. Este concepută pentru a fi integrată în scripturi pentru a automatiza monitorizarea stării hardware-ului și gestionarea stabilității aplicațiilor.

Chalice is a framework for building and deploying serverless applications and REST APIs on AWS Lambda using Python. It functions as an infrastructure-as-code generator, mapping application logic and routing definitions directly to cloud compute resources while automating the provisioning and management of the underlying environment. The framework distinguishes itself by analyzing source code to automatically construct the minimum necessary security permissions, ensuring least-privilege access for all deployed functions. It supports modular development through blueprint-based organization and

Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain

Supervisor is a process control system for Unix environments that ensures background processes remain running by automatically restarting them if they crash or exit. It functions as a daemon manager that provides a centralized way to start, stop, and monitor the lifecycle of long-running background tasks. The system utilizes a client-server architecture to control multiple processes through a command line interface. This allows for the orchestration of system services and background daemon control without requiring manual shell intervention. The tool covers application process supervision an

Chef is a configuration management platform and infrastructure as code framework used to automate the deployment and maintenance of infrastructure state across a fleet of servers. It operates as an idempotent automation engine, ensuring systems converge to a desired state by applying only the necessary changes to resolve differences. The system functions as a multi-platform server orchestrator capable of managing infrastructure across different operating systems, cloud providers, and hardware architectures. It includes a dedicated infrastructure testing framework to verify configuration code

Puppet is an infrastructure as code tool and configuration management framework used to automate the provisioning and state orchestration of server fleets. It functions as a declarative state orchestrator that manages server configurations and system settings to ensure consistency and reproducibility across a fleet of machines. The system utilizes a declarative state modeling approach and an idempotent execution engine to maintain configuration state and prevent environment drift. It employs resource-based abstraction and a client-server architecture to translate high-level specifications int

sh is a Python process management library that provides programmatic wrappers and interfaces for controlling Unix system commands and child process lifecycles. It functions as an asynchronous process wrapper, allowing shell commands and system programs to run within a non-blocking event loop. The library maps command-line arguments and standard input/output streams to native Python functions and objects. It includes a process lifecycle controller to manage signal groups, execution timeouts, and process permissions for spawned child processes. The project provides capabilities for executable

OpenStack is an open-source cloud computing platform for building and managing public and private cloud infrastructure at scale. It provides a framework for deploying, configuring, and operating cloud services, orchestrating compute, storage, and networking resources across a datacenter through a unified management layer. The platform is built on a decoupled service architecture where individual cloud services are developed and versioned independently within their own repositories. This meta-repository tracks interoperable versions of all OpenStack components as verified submodules, with each

pyinfra is a Python-based infrastructure automation framework that turns Python code into shell commands for managing servers, Docker containers, and local machines. It operates as a declarative, idempotent deployment tool, applying desired system states by comparing target configurations against current states and making only the necessary changes. The framework provides a connector-based transport abstraction that unifies SSH, Docker, and local execution behind a common interface, with a parallel execution engine that manages concurrent operations across hosts. The tool distinguishes itself

Acest proiect este un orchestrator de backup Unix utilizat pentru modelarea și executarea protecției datelor full-stack. Funcționează ca un sistem de gestionare pentru dump-uri de baze de date, arhivare criptată, rotația versiunilor și transportul stocării la distanță. Sistemul se distinge prin orchestrarea instrumentelor native de sistem pentru diverse baze de date, inclusiv PostgreSQL, MySQL, MongoDB, Redis și Riak. Utilizează un flux de lucru de arhivare securizat care combină compresia și criptarea folosind GPG, OpenSSL sau AES înainte de a transporta pachetele către servicii compatibile S3, Dropbox sau servere remote prin SFTP și RSync. Capabilitățile largi includ automatizarea sincronizării datelor prin transferuri delta și încărcări fragmentate, precum și gestionarea stării de retenție pentru a roti și curăța arhivele istorice. Orchestratorul dispune, de asemenea, de un sistem de notificare multi-canal care se integrează cu email, HTTP POST, PagerDuty și diverse platforme de chat pentru a alerta administratorii cu privire la rezultatele operațiunilor. Utilizatorii pot defini aceste fluxuri de lucru folosind un model bazat pe configurație care suportă injectarea dinamică a variabilelor și verificarea sintaxei.

Mina este un instrument de deployment la distanță bazat pe Git și de automatizare a deployment-ului prin SSH, conceput pentru a gestiona lansările de aplicații. Funcționează ca un manager de release-uri bazat pe symlink-uri care clonează codul sursă din repository-uri Git direct pe servere și este conceput special pentru a gestiona deployment-ul proiectelor Ruby și configurarea mediului. Sistemul automatizează actualizările serverului prin generarea unui singur script bash local și executarea acestuia printr-o singură sesiune SSH. Această abordare permite deployment-uri fără downtime prin utilizarea directoarelor de release cu marcaj temporal și actualizarea unui link simbolic pentru a comuta instantaneu între versiunea activă și cea anterioară. Instrumentul acoperă un flux de lucru de automatizare extins, incluzând execuția de comenzi la distanță, instalarea dependențelor și orchestrarea sarcinilor de build. De asemenea, oferă mecanisme pentru rollback-ul deployment-ului și curățarea automată a release-urilor pentru a menține un număr configurabil de build-uri recente.

Cloud-init is an automated server provisioning and instance initialization tool designed to configure virtual machines during the early boot process. It functions as a metadata provisioner that retrieves instance configuration data from cloud providers to set up network, storage, and user settings. The project provides a cross-distribution boot configuration layer that applies consistent system settings across different Linux distributions. It utilizes a modular provider abstraction to handle API differences between various cloud platforms and employs a staged boot execution model to ensure i