68 Repos
Configures and provisions compute resources for workflow execution across cloud environments.
Distinct from Managed Infrastructure Deployment: Focuses on the provisioning of infrastructure for workflows, distinct from general managed infrastructure deployment.
Explore 68 awesome GitHub repositories matching devops & infrastructure · Infrastructure Deployment Provisioning. Refine with filters or upvote what's useful.
Hyperframes is an HTML-to-video rendering engine and composition tool that transforms web layouts and CSS into encoded video files. It functions as a headless browser video pipeline and a distributed video rendering framework, allowing users to create seekable animations and programmatic motion designs using HTML, CSS, and JavaScript. The project differentiates itself as an AI agent video orchestrator, enabling the automation of video scripts and compositions through natural language prompts. It supports distributed video encoding by splitting rendering tasks across multiple serverless functi
Provides dedicated constructs to set up the cloud topology and provision resources for render handlers.
Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep
Provisions compute resources for workflow execution.
kops is a Kubernetes cluster provisioner and lifecycle manager designed to automate the creation, maintenance, and destruction of production-grade clusters on cloud infrastructure. It functions as a declarative infrastructure manager, synchronizing the live state of a cluster with versioned manifests stored in remote object storage to ensure idempotent operations. The project distinguishes itself by offering comprehensive automation for the entire cluster lifecycle, including high-availability control plane deployment, incremental rolling updates, and automated version upgrades. It also serve
Generates Terraform configurations from the current cluster state to allow management via external code.
Terraformer is a reverse engineering tool and infrastructure-to-code generator that transforms existing live cloud resources into declarative configuration files and state manifests. It functions as a cloud infrastructure exporter, allowing users to extract resource metadata from cloud providers to create reproducible infrastructure deployments. The tool specializes in reverse engineering by querying cloud provider APIs to map active resource configurations and translate them into Terraform resource blocks. It supports infrastructure state recovery by reconstructing state files from live envi
Reconstructs Terraform state files from a live cloud environment when original configuration files are lost.
Zappa is a deployment tool and orchestrator designed to package and deploy Python web applications to AWS Lambda. It functions as a wrapper and framework that adapts standard Python applications to work with serverless infrastructure and API Gateway events. The project enables the hosting of Python web frameworks on serverless environments without requiring the application to be rewritten. It automates the process of pushing code from local environments to the cloud and manages the lifecycle of these deployments to remove manual server management. Its capabilities include automated infrastru
Generates and deploys CloudFormation templates to automatically set up API Gateway and Lambda triggers.
Azure Docs is the official technical documentation repository for Microsoft Azure, the cloud computing platform. It provides comprehensive guidance on the full spectrum of Azure services, covering everything from core infrastructure components like virtual machines, Kubernetes clusters, and serverless computing to platform services for AI, machine learning, data analytics, and storage. The documentation details how to provision, manage, and govern cloud resources at scale, including policy enforcement, identity management, and cost optimization. The documentation distinguishes Azure through i
Documents how to provision Azure infrastructure using Terraform declarative configuration.
This is an infrastructure as code tool and serverless deployment orchestrator that provides a shorthand syntax for defining serverless infrastructure. It functions as a framework for transforming concise resource declarations into full AWS CloudFormation templates to automate the provisioning of cloud functions, APIs, and databases. The project distinguishes itself by using a macro-based transformation system to expand simplified resource types into detailed infrastructure components. It includes an automated permission mapping system that translates high-level resource interaction intents in
Automates the generation and deployment of AWS CloudFormation templates using macros and transforms to reduce boilerplate.
Apache Beam is a distributed data pipeline framework and unified data processing model designed to handle both bounded batch data and unbounded real-time streams. It provides a system for building scalable, data-parallel workflows that operate across compute clusters using a single programming model. The framework utilizes a cross-runner pipeline abstraction that decouples the data processing logic from the underlying execution backend, allowing the same pipeline to run on different distributed compute engines. It supports multi-language pipeline development by translating high-level code fro
Configures pipelines to execute across different backend runners to manage workload distribution.
Travis CI is a continuous integration platform and CI/CD pipeline orchestrator that automates the testing and building of code changes from version control systems. It functions as a multi-language test runner and build infrastructure manager, ensuring software quality through automated testing across various programming languages and runtimes. The platform is distinguished by its use of virtual-machine-based isolation for reproducible environments and a configuration-driven approach to pipeline generation. It supports complex testing strategies through parallel matrix execution, allowing job
Automatically pushes files to AWS CloudFormation to provision infrastructure after a successful build.
Moto is a cloud service mockery framework and API mock server that simulates AWS infrastructure locally. It allows developers to test cloud-dependent code and verify infrastructure-as-code templates without deploying real resources or incurring costs. The project functions as an SDK interceptor that can patch existing service clients to redirect requests to a local mock environment. It can also be run as a standalone HTTP server, enabling any programming language to interact with the simulated endpoints. The framework covers a vast array of simulated capabilities, including data storage, com
Simulates the validation and creation of infrastructure-as-code stacks using CloudFormation templates.
Score is a platform-agnostic workload specification standard that defines containerized application deployments and their resource dependencies in a declarative YAML format. It provides a developer-centric specification that separates environment-agnostic workload definitions from environment-specific configuration, enabling consistent deployment across development, testing, and production environments. The specification framework translates a single workload definition into deployable manifests for multiple container orchestration platforms, including Docker Compose and Kubernetes. It includ
Automatically creates required backing services like databases when deploying workload definitions.
karpenter-provider-aws is a Kubernetes node autoscaler and infrastructure provider for AWS. It serves as a node lifecycle manager and cluster cost optimizer that automatically provisions and removes compute instances based on the resource requirements of pending pods. The project distinguishes itself through advanced AWS spot instance orchestration and price-capacity optimized selection to reduce cloud spend. It minimizes costs by consolidating underutilized nodes and prioritizing spot or reserved instances over on-demand capacity, while proactively migrating workloads before cloud provider i
Selects the most appropriate instance types by matching requirements against hardware attributes like CPU, memory, and storage.
Shuttle is a cloud platform for Rust backends that automates infrastructure provisioning and deployment. It functions as an infrastructure-as-code framework where managed databases and cloud resources are defined directly within application logic using code attributes rather than external configuration files. The platform provides a command line interface to manage the full project lifecycle, from local development with live reloading to remote cloud publishing. It includes a managed database provider that automatically provisions and attaches storage to applications during the deployment pro
Provides infrastructure provisioning defined directly within application code using Rust attributes.
Agones is a Kubernetes game server orchestrator designed for hosting, scaling, and managing dedicated multiplayer game servers. It extends the Kubernetes control plane using custom resource definitions to define game server and fleet objects, utilizing a dedicated fleet manager to maintain pools of warm server instances. The system provides a game server SDK and language-specific client libraries that allow server processes to signal readiness, health, and shutdown states directly to the controller. It distinguishes itself through specialized scaling logic, including the use of WebAssembly mo
Automates cluster provisioning and controller installation using declarative Terraform configuration files.
The AWS SAM Command Line Interface is a development toolkit used to define, emulate, and manage the lifecycle of serverless infrastructure. It serves as an infrastructure as code tool and a wrapper for AWS CloudFormation, allowing users to describe cloud resources through declarative templates. The project differentiates itself by providing a local serverless emulator that uses containers to execute and debug functions before they are deployed. It also enables rapid cloud iteration through real-time synchronization, which monitors local source code for changes and automatically pushes updates
Provides a simplified syntax for generating and deploying AWS CloudFormation templates tailored for serverless architectures.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Provides options for deploying dedicated cloud instances to ensure physical resource isolation and compliance.
The CNCF Curriculum is an open-source repository that organizes exam domains and learning paths for CNCF certification courses covering Kubernetes and cloud-native technologies. It structures certification content into weighted domains that reflect exam question distribution, providing a structured study guide for candidates preparing for CNCF certifications. The curriculum is organized around multiple cloud-native domains including networking, security, GitOps, platform engineering, and certification preparation. It teaches cloud-native concepts through the lens of building and operating int
Teaches using platform APIs to automate infrastructure provisioning and reduce manual setup.
Osmedeus is a security workflow orchestration engine that coordinates AI agents, shell commands, and scanning tools through declarative YAML pipelines. It functions as a distributed security scanner, a declarative workflow automator, and an AI agent framework for security, enabling automated multi-step security analysis with conditional branching, parallel execution, and distributed workers. The engine distinguishes itself through a hybrid runner model that executes workflow steps on the local host, inside Docker containers, or over SSH to remote machines, selected per step or module. It supp
Attaches security scan workflows to already-running cloud machines instead of provisioning new ones.
This project is a reference implementation of Domain-Driven Design, Clean Architecture, and Command Query Responsibility Segregation (CQRS) patterns using the Go programming language. It serves as a sample application to demonstrate how to decouple core domain rules from infrastructure and delivery mechanisms. The system is built as a gRPC microservices architecture, utilizing type-safe communication and service contracts. It implements an event-driven architecture to manage eventual consistency and asynchronous processing, specifically employing the Outbox pattern to ensure reliable messagin
Automates the provisioning of cloud resources and server configurations using declarative infrastructure-as-code modules.
This repository is a collection of hands-on AWS learning labs that pair visual architecture diagrams with real infrastructure deployment. Each lab is built around a complete architecture diagram, and the learner follows step-by-step instructions to implement that exact design using pre-authored AWS CloudFormation templates. The core approach is to teach cloud concepts by having the learner build the infrastructure they see in the diagram, reinforcing understanding through direct, practical construction. The labs are designed as complete, multi-service integration demos that combine compute, s
Deploys complete cloud environments using pre-authored AWS CloudFormation templates that provision all resources automatically.