orchest/orchestArchived
Orchest
Orchest 是一个数据流水线编排器和容器化工作流管理器。它提供了一个平台，通过图形界面和脚本的结合来设计、调度和执行复杂的数据处理序列。
该平台通过使用容器管理软件依赖项而脱颖而出，确保了跨不同环境的一致执行。它具有一个多语言任务调度器，能够触发用多种编程语言编写的作业，并包含一个跟踪项目配置和代码历史快照的版本控制系统。
系统涵盖了可视化工作流设计和基于图的依赖映射，以及用于循环或即时执行的时间触发任务调度。它还支持部署在流水线运行期间保持活跃的持久化后台服务。
Features
- Data Pipeline Orchestration - Provides a platform for designing, scheduling, and monitoring complex sequences of data processing tasks.
- Data Pipeline Orchestrators - Provides a professional platform for automating complex sequences of data processing tasks.
- Nodal Workflow Designers - Provides a nodal interface for constructing and managing modular data processing pipelines through visual connections.
- Polyglot Execution Orchestrators - Provides a polyglot execution runtime that manages the sequential execution of code across diverse language runtimes.
- Scripted Workflow Automations - Implements a scripting language to define the order and flow of data processing tasks, replacing manual sequences.
- Scripted Pipeline Logic - Uses a domain-specific scripting language to define the logic and order of data processing sequences.
- Workflow Managers - Acts as a platform that uses containers to manage software dependencies and ensure consistent workflow execution.
- Containerized - Uses containers to isolate software requirements for each task, preventing version conflicts across different computing environments.
- Execution Environment Configurations - Defines software dependencies and parameters to ensure workflows execute consistently across different machines.
- Polyglot Task Processors - Triggers data processing jobs written in multiple programming languages using a polyglot task processor.
- Polyglot Workflow Orchestration - Provides a managed environment that coordinates business logic and state across multiple different programming language runtimes in a single workflow.
- Graph-Based Workflow Models - Implements graph-based workflow models to map task dependencies and execution sequences visually.
- Recurring Task Schedulers - Ships utilities for executing specific workflow subsets immediately or repeatedly at fixed time intervals.
- Container-Based Isolation - Provides container-based isolation to ensure task-specific software dependencies remain consistent across different hardware architectures.
- Visual Workflow Orchestrators - Provides a graphical user interface for managing task dependencies and execution order through visual representations.
- Data Pipeline Flow Designers - Provides a graphical user interface for mapping task dependencies and designing data processing flows visually.
- Batch Processing Schedulers - Automates and manages the execution of recurring data processing jobs on a scheduled basis.
- Version Control Snapshots - Tracks historical changes to project configurations and code through a system of versioned immutable snapshots.
- Time-Based Triggers - Executes workflow subsets based on recurring calendar intervals or immediate manual trigger requests.
- Persistent Background Services - Launches persistent background services that remain active for the entire duration of a pipeline execution.
- Configuration Version Control - Integrates version control to track and audit historical changes to project configurations and code.
- Workflow Orchestration - Visual pipeline editor and workflow orchestrator for Kubernetes.
- Data Pipelines - No-code builder for data pipelines.
- Data Orchestration - Visual interface for building and managing data pipelines.
- GitOps And Continuous Delivery - Tool for building data pipelines with Jupyter notebook support.
- Workflow Platforms - Integrated development environment for data science workflows.
