Netflix/conductorArchived
Conductor
Conductor is a distributed workflow manager and microservices orchestration engine. It coordinates long-running business processes across a network of services, using a stateful orchestration model to ensure consistent execution order and reliable state management.
The system defines task sequences and conditional business logic using structured JSON configuration files. It manages the execution of complex operations across distributed systems with built-in persistence and failure recovery, tracking the progress of processes through a backend database.
The platform provides capabilities for business process automation and distributed task coordination. It includes mechanisms to index workflow data for efficient retrieval and offloads large payloads to external storage to maintain performance in the primary orchestration database.
Features
- Microservices Orchestration - Manages the lifecycle and communication of independent services in distributed architectures.
- Business Process Automation - Defines and executes automated business workflows triggered by data events or external signals.
- Workflow Orchestration - Provides a system for defining and executing automated business processes and sequences using JSON configurations.
- State Management Systems - Persists and tracks the status of long-running distributed processes for failure recovery.
- Workflow State Managers - Manages complex task sequences with persistent state tracking and failure recovery to ensure process continuity.
- Task Coordinations - Synchronizes workflows and tracks task completion across distributed nodes.
- Durable Execution Persistence - Implements mechanisms for saving workflow state to ensure recoverability after system failures.
- JSON Workflow Specifications - Defines task sequences and conditional logic using structured JSON configuration files parsed at runtime.
- Microservices Process Coordinators - Chains microservice calls into observable execution pipelines to coordinate distributed tasks.
- State Machine Orchestrators - Manages complex business logic through state transitions and persistent execution history.
- Workflow Execution Managers - Provides a centralized system to coordinate task execution and prevent redundant job processing across a network.
- Workflow Logic Engines - Provides a system for defining and executing conditional branching and task routing in automated processes.
- Execution Record Indexing - Uses a searchable backend to organize and query workflow execution records based on metadata.
- Large Data Offloading - Provides techniques for storing large data fields externally to optimize primary database performance.
- Search Indexing - Indexes operational workflow data to enable efficient querying and retrieval of execution records.
- Polling-Based Worker Execution - Uses an execution model where workers continuously poll the server for pending tasks.
- Workflow Orchestration - Engine for orchestrating microservices-based workflows.
- Workload Orchestration and Scheduling - Microservices orchestration engine.
