1 个仓库
Integrations that embed conversational models and lifecycle management tools directly into data processing pipelines.
Distinct from Machine Learning Platforms: Distinct from general ML platforms: focuses on the integration of AI tools into data orchestration workflows.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Data Workflow Integrations. Refine with filters or upvote what's useful.
Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative modeling and version-controlled code. It functions as a workflow engine that treats data assets as first-class primitives, allowing teams to define, schedule, and monitor complex pipelines while maintaining clear visibility into lineage, dependencies, and data quality. The platform distinguishes itself by using a code-as-configuration framework that enables standard software engineering practices, such as unit testing and local mocking, to be applied directly to data workflows.
Incorporates conversational models and lifecycle management tools directly into data workflows to automate complex processing.