Projects sharing features with Cromwell

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Workflows for Fission: Fast, reliable and lightweight function composition for serverless functions

Nextflow is a dataflow workflow engine and distributed computing framework used to build and execute data-intensive pipelines. It serves as a scientific workflow language that allows users to define reproducible data processing sequences, supporting any scripting language through shebang declarations. The system functions as a containerized pipeline orchestrator, utilizing container technologies to ensure software dependencies remain consistent across different environments. It decouples workflow logic from the underlying infrastructure, enabling the same pipeline to run on local machines, cl

Container-native task automation engine.

The official repository for the AiiDA code

Kestra is a declarative workflow orchestrator designed to manage complex task dependencies and automated processes through versioned configuration files. It functions as a distributed platform that decouples task scheduling from execution by offloading computational workloads to a fleet of worker nodes. The system uses a reactive, event-driven engine to initiate workflows automatically in response to external signals, webhooks, schedules, or file system changes. The platform distinguishes itself through a modular plugin architecture that allows for the integration of custom tasks and external

Mirror of Apache Oozie

Airflow is a workflow orchestration platform for authoring, scheduling, and monitoring complex data pipelines as code using Python. It employs a DAG-based task scheduler to manage execution timing and dependencies via directed acyclic graphs, utilizing a distributed task execution engine to run workloads across a cluster of worker nodes. The platform provides a data pipeline monitor for tracking the health and execution history of programmatic workflows. This includes a web interface for workflow progress visualization and health monitoring to identify and troubleshoot pipeline failures. The

High throughput workflows and automation for HPC

Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the…

Event-driven scripting for Kubernetes

Spark Kernel

Welcome to Livy

Workflow Description Language - Specification and Implementations

Open-source platform that unifies AI agent orchestration and workflow automation — autonomy and precision in one platform.

Camunda is a business process automation platform and orchestration tool used to model, deploy, and monitor automated workflows and human-centric tasks. It features a BPMN workflow engine for executing processes based on the BPMN 2.0 standard and a DMN decision engine for automating business logic and rule evaluation. The platform is designed for flexibility through an embedded workflow library that allows the engine to be integrated directly into custom applications. It supports multi-tenant workflow management, enabling the secure separation of process definitions and instance data for mult

An engine for managing the execution of container-based workflows.

CGAT-ruffus is a lightweight python module for running computational pipelines

【A common used C++ & Python DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

This project is a Python workflow orchestration platform and programmatic data pipeline engine used to author, schedule, and monitor complex data pipelines. It functions as a directed acyclic graph manager and scheduler, allowing users to define data movement and transformation tasks as code to ensure precise execution order and maintainability. The platform distinguishes itself by treating workflows as code, enabling pipelines to be versioned and tested through a standard programming language. It utilizes a system of extensible operators to encapsulate integration logic and employs a templat