10 dépôts
Mechanisms for triggering and managing the execution of remote serverless functions.
Distinguishing note: Focuses on the remote invocation of workers rather than local function execution.
Explore 10 awesome GitHub repositories matching devops & infrastructure · Remote Worker Execution. Refine with filters or upvote what's useful.
Puter is a browser-based desktop environment and cloud-native development platform that provides a virtualized graphical workspace. It enables developers to build and deploy full-stack web applications by integrating cloud storage, authentication, and serverless backend logic directly into the browser, eliminating the need for traditional server infrastructure. The platform distinguishes itself through a unified cloud storage layer and a distributed network runtime that facilitates peer-to-peer communication and cross-origin resource fetching. It features a sophisticated cross-window orchestr
Triggers serverless functions by providing target URLs and configuration parameters to process remote operations.
Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep
Enables the creation of specialized infrastructure handlers to manage execution on platforms not natively supported.
iii is a distributed service orchestrator and event-driven workflow engine designed to compose and manage cross-language functions and workers through a central execution engine. It functions as a multi-language service mesh and WebSocket service gateway, providing a persistent communication layer for remote service workers. The platform enables dynamic runtime extensions, allowing new workers and capabilities to be deployed and registered into a live environment without requiring system restarts. It distinguishes itself by offering machine-readable skill exposure and agent capability integra
Manages the invocation and handling of remote workers using queues and custom triggers.
OneDev is a self-hosted, unified development platform that integrates Git repository hosting, issue tracking, and continuous integration and deployment (CI/CD) into a single system. It provides a comprehensive environment for managing the entire software lifecycle, allowing teams to coordinate code reviews, track development tasks, and automate build pipelines through a centralized interface. The platform distinguishes itself by offering browser-based, containerized development environments that allow developers to access and edit project files directly on the server. Its build system utilize
Offloads build jobs to remote worker nodes to scale processing capacity across diverse infrastructure.
Openwork is an LLM agent orchestration platform and cross-platform desktop application designed for building and running automated workflows. It serves as a local AI agent host and session manager, allowing users to connect local project folders to various large language models and remote cloud workers. The project distinguishes itself through a local-first execution model that enables agents to process files directly on a host machine. It implements human-in-the-loop permissioning to intercept agent resource requests, requiring explicit user approval before accessing specific local system fi
Links the local desktop interface to remote cloud workers to scale processing power for complex tasks.
Jenkins-Zero-To-Hero is an educational course and DevOps engineering curriculum designed to teach the practical application of Jenkins for continuous integration and delivery. It serves as a comprehensive guide and tutorial for building automated software release lifecycles. The material specifically focuses on Jenkins Docker integration, providing instructional guides for configuring Docker agents and executing build pipelines within isolated container environments. It covers the development of pipelines as code using declarative scripts to ensure repeatable deployment processes. The curric
Provides instructions for offloading heavy build tasks to remote worker nodes to improve scalability.
Feast is an open-source feature store for machine learning that provides a central platform for defining, storing, and serving features across both training and inference workflows. It operates as a declarative system where feature definitions are written as code in Python files, synchronized to a central registry, and made available for low-latency online retrieval or point-in-time correct historical joins for training datasets. The project abstracts storage behind a pluggable architecture, allowing offline and online backends to be swapped without changing retrieval logic, and coordinates ma
Runs custom setup and teardown logic for materialization-specific infrastructure during apply and teardown.
Osmedeus is a security workflow orchestration engine that coordinates AI agents, shell commands, and scanning tools through declarative YAML pipelines. It functions as a distributed security scanner, a declarative workflow automator, and an AI agent framework for security, enabling automated multi-step security analysis with conditional branching, parallel execution, and distributed workers. The engine distinguishes itself through a hybrid runner model that executes workflow steps on the local host, inside Docker containers, or over SSH to remote machines, selected per step or module. It supp
Executes arbitrary shell commands on cloud instances for security scanning and automation tasks.
Ce projet est un orchestrateur d'infrastructure serverless et un outil de déploiement conçu pour héberger des applications Next.js sur AWS. Il fonctionne comme un framework de déploiement pour le edge computing et un wrapper d'infrastructure-as-code qui automatise le provisionnement de fonctions AWS Lambda, de buckets S3 et de distributions CloudFront. Le système se distingue par la distribution du rendu côté serveur et des routes API sur des emplacements edge mondiaux afin de réduire la latence. Il s'intègre directement aux réseaux de diffusion de contenu (CDN) pour optimiser la livraison des assets statiques et des pages rendues, tout en fournissant une couche pour encapsuler les gestionnaires d'application pour une compatibilité avec les environnements serverless. La plateforme couvre de larges domaines de capacités, notamment la diffusion de contenu mondiale, l'infrastructure API serverless et la configuration automatisée des ressources. Elle gère le trafic via une logique de routage edge et la gestion de l'internationalisation, tout en supportant des stratégies de performance telles que la régénération statique incrémentale et l'optimisation d'images en edge. L'infrastructure est gérée via des configurations Terraform, offrant un contrôle sur les limites de mémoire, les durées de timeout et les attributions de permissions IAM.
Supports replacing default execution logic with custom handler files to control request processing.
Ce projet est un guide pédagogique structuré et un programme pour maîtriser l'infrastructure en tant que code (IaC). Il fonctionne comme un guide de provisionnement cloud et un matériel de formation DevOps, fournissant un ensemble de leçons et d'exercices pratiques pour déployer et gérer les ressources cloud via une configuration déclarative. Le programme couvre le développement de modules réutilisables, l'orchestration de multiples environnements utilisant des espaces de travail et la gestion de fichiers d'état distants avec des mécanismes de verrouillage. Il inclut également des instructions sur la gestion des secrets cloud pour sécuriser les données sensibles. Le matériel couvre les capacités fondamentales de l'infrastructure en tant que code, incluant la configuration du fournisseur, la paramétrisation pilotée par les variables et l'utilisation de logique dynamique et de fonctions pour des configurations flexibles. Il aborde en outre le provisionnement des ressources et la récupération de données externes.
Executes custom shell commands on provisioned cloud instances for final system customizations.