How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative modeling and version-controlled code. It functions as a workflow engine that treats data assets as first-class primitives, allowing teams to define, schedule, and monitor complex pipelines while maintaining clear visibility into lineage, dependencies, and data quality. The platform distinguishes itself by using a code-as-configuration framework that enables standard software engineering practices, such as unit testing and local mocking, to be applied directly to data workflows.
The official repository for the AiiDA code
The main features of aiidateam/aiida-core are: General Purpose Orchestration, Workflow Frameworks.
Open-source alternatives to aiidateam/aiida-core include: couler-proj/couler — Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows,… fission/fission-workflows — Workflows for Fission: Fast, reliable and lightweight function composition for serverless functions. broadinstitute/cromwell — Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to… agnostiqhq/covalent — Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute… dagster-io/dagster — Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative… kestra-io/kestra — Kestra is a declarative workflow orchestrator designed to manage complex task dependencies and automated processes…