1 repository
Awesome GitHub RepositoriesWorkflow Schedulers
Centralized services that manage task queues and track global workflow state across distributed environments.
Distinct from Centralization Patterns: Distinct from general centralization patterns: focuses specifically on workflow and task orchestration.
Explore 1 awesome GitHub repository matching software engineering & architecture · Workflow Schedulers. Refine with filters or upvote what's useful.
Awesome Workflow Schedulers GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- spotify/luigi
spotify/luigi
18,676Vezi pe GitHubLuigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a workflow orchestration engine that organizes tasks into directed acyclic graphs, ensuring that jobs execute in the correct logical order based on their dependencies. By utilizing a centralized scheduler, the system coordinates task execution across distributed environments, tracks global workflow state, and prevents redundant processing by verifying the existence of output targets before triggering any work. The project distinguishes itself through a robust state-tracking mechanism t
Coordinates task execution and tracks global workflow state through a centralized server.
Pythonhadoopluigiorchestration-framework
