awesome-repositories.com
Blog
MCP
awesome-repositories.com

Descoperă cele mai bune repository-uri open source cu căutare AI.

ExploreazăCăutări recomandateAlternative open-sourceSoftware self-hostedBlogHartă site
ProiectDespreCum realizăm clasamentulPresăServer MCP
LegalConfidențialitateTermeni
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
apache avatar

apache/dolphinscheduler

0
View on GitHub↗
14,329 stele·5,052 fork-uri·Java·Apache-2.0·14 vizualizăridolphinscheduler.apache.org↗

Dolphinscheduler

DolphinScheduler is a distributed workflow orchestrator designed to manage and automate complex data processing pipelines. It functions as a data pipeline scheduler that coordinates multi-step tasks across distributed environments, ensuring reliable execution through defined dependencies and sequences.

The platform utilizes a directed acyclic graph model to represent workflows, allowing users to define task relationships via a visual interface. It employs a master-worker architecture supported by a pluggable task plugin system, which enables the dynamic extension of task types without requiring modifications to the core codebase.

The system provides comprehensive monitoring and observability tools to track the status and performance of distributed tasks in real-time. By integrating automated scheduling and recurring task management, it facilitates the coordination of large-scale data processing jobs across diverse infrastructure components.

Features

  • Distributed Task Schedulers - Provides a platform for defining, scheduling, and monitoring complex data processing pipelines across distributed environments.
  • Data Pipeline Orchestration - Manages complex multi-step data processing tasks across distributed systems via a visual interface.
  • Workflow Orchestrators - Orchestrates complex, multi-step data processing workflows across distributed environments using dependency-based scheduling.
  • Task Schedulers - Automates the execution of recurring data pipelines on fixed timetables or specific triggers.

Căutare AI

Explorează mai multe repository-uri excelente

Descrie ce ai nevoie în limbaj simplu — AI-ul sortează mii de proiecte open source selectate în funcție de relevanță.

Start searching with AI
Task Scheduling - Automates recurring data pipeline execution to ensure consistent processing without manual intervention.
  • Directed Acyclic Graph Execution Engines - Represents workflows as directed acyclic graphs to define task dependencies and ensure correct execution order.
  • Task Monitoring - Provides real-time observability into the execution status and performance of multi-step workflows.
  • Workflow Monitoring Systems - Provides real-time observability into the status and performance of distributed tasks within complex pipelines.
  • General Purpose Orchestration - Distributed, extensible workflow scheduler with visual DAG management.
  • Java 项目 - Listed in the “Java 项目” section of the Great Open Source Project awesome list.
  • Data Processing Workflows - Coordinates large-scale data processing jobs across diverse infrastructure to ensure reliable data movement.
  • Worker Node Management - Manages distributed worker nodes through a central master node for task execution across a cluster.
  • Distributed Coordination Services - Provides consensus-based coordination for leader election, service discovery, and health monitoring in distributed clusters.
  • Workflow Monitoring - Tracks the lifecycle and execution progress of distributed tasks to identify bottlenecks in real-time.
  • Plugin-Based Architectures - Implements a pluggable architecture that allows dynamic loading of task modules without modifying core code.
  • State Persistence - Stores workflow metadata and execution logs in a relational database to ensure system recovery and task continuity.

    • Istoric stele

    Graficul istoricului de stele pentru apache/dolphinschedulerGraficul istoricului de stele pentru apache/dolphinscheduler

    Alternative open-source pentru Dolphinscheduler

    Proiecte open-source similare, clasificate după numărul de funcționalități comune cu Dolphinscheduler.
    • prefecthq/prefectAvatar PrefectHQ

      PrefectHQ/prefect

      21,640Vezi pe GitHub↗

      Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep

      Pythonautomationdatadata-engineering
      Vezi pe GitHub↗21,640
    • apache/airflowAvatar apache

      apache/airflow

      45,902Vezi pe GitHub↗

      Airflow is a platform for programmatically authoring, scheduling, and monitoring complex data pipelines. It functions as a workflow automation engine that manages the lifecycle of recurring business processes by executing code-defined task dependencies. By representing workflows as directed acyclic graphs, the system ensures that task execution order and data flow are explicitly defined and reliably maintained across distributed computing environments. The platform distinguishes itself through a highly modular, provider-based architecture that decouples core orchestration logic from external

      Pythonairflowapacheapache-airflow
      Vezi pe GitHub↗45,902
    • spotify/luigiAvatar spotify

      spotify/luigi

      18,676Vezi pe GitHub↗

      Luigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a workflow orchestration engine that organizes tasks into directed acyclic graphs, ensuring that jobs execute in the correct logical order based on their dependencies. By utilizing a centralized scheduler, the system coordinates task execution across distributed environments, tracks global workflow state, and prevents redundant processing by verifying the existence of output targets before triggering any work. The project distinguishes itself through a robust state-tracking mechanism t

      Pythonhadoopluigiorchestration-framework
      Vezi pe GitHub↗18,676
    • hatchet-dev/hatchetAvatar hatchet-dev

      hatchet-dev/hatchet

      6,622Vezi pe GitHub↗

      Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it

      Goconcurrencydagdistributed
      Vezi pe GitHub↗6,622
    Vezi toate cele 30 alternative pentru Dolphinscheduler→

    Întrebări frecvente

    Ce face apache/dolphinscheduler?

    DolphinScheduler is a distributed workflow orchestrator designed to manage and automate complex data processing pipelines. It functions as a data pipeline scheduler that coordinates multi-step tasks across distributed environments, ensuring reliable execution through defined dependencies and sequences.

    Care sunt principalele funcționalități ale apache/dolphinscheduler?

    Principalele funcționalități ale apache/dolphinscheduler sunt: Distributed Task Schedulers, Data Pipeline Orchestration, Workflow Orchestrators, Task Schedulers, Task Scheduling, Directed Acyclic Graph Execution Engines, Task Monitoring, Workflow Monitoring Systems.

    Care sunt câteva alternative open-source pentru apache/dolphinscheduler?

    Alternativele open-source pentru apache/dolphinscheduler includ: prefecthq/prefect — Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as… apache/airflow — Airflow is a platform for programmatically authoring, scheduling, and monitoring complex data pipelines. It functions… spotify/luigi — Luigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a… hatchet-dev/hatchet — Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for… hazelcast/hazelcast — Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to… nextflow-io/nextflow — Nextflow is a dataflow workflow engine and distributed computing framework used to build and execute data-intensive…