2 个仓库
Awesome GitHub RepositoriesInline Script Execution
Mechanisms for embedding and executing custom code directly within pipeline task definitions.
Distinct from Inline Logic Execution: Distinct from general inline logic execution: focuses on pipeline-specific task execution contexts rather than template rendering.
Explore 2 awesome GitHub repositories matching data & databases · Inline Script Execution. Refine with filters or upvote what's useful.
Awesome Inline Script Execution GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- spotify/luigi
spotify/luigi
18,676在 GitHub 上查看Luigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a workflow orchestration engine that organizes tasks into directed acyclic graphs, ensuring that jobs execute in the correct logical order based on their dependencies. By utilizing a centralized scheduler, the system coordinates task execution across distributed environments, tracks global workflow state, and prevents redundant processing by verifying the existence of output targets before triggering any work. The project distinguishes itself through a robust state-tracking mechanism t
Provides templates for defining processing tasks that require specific execution contexts directly within a pipeline.
Pythonhadoopluigiorchestration-framework - tfeldmann/organize
tfeldmann/organize
3,077在 GitHub 上查看Organize is a command-line utility designed to automate file system management, storage cleanup, and directory organization. It functions as a rule-based engine that processes files through sequential pipelines, allowing users to define complex workflows for moving, renaming, and managing local data. The system utilizes structured configuration files to map file system triggers to specific actions. It distinguishes itself through a simulation engine that allows users to preview the impact of their rules on a virtual file system before applying changes, ensuring data integrity. Additionally, t
Executes inline shell commands within automation workflows to handle complex file processing tasks.
Pythonautomaticcommand-line-tooldocument-management
