1 Repo
Deployment of background processes that remain active across the duration of a workflow execution.
Distinct from Long-Running Task Output Streams: Unlike the candidates which focus on API polling or mobile persistence, this is about lifecycle-bound infrastructure services for pipelines.
Explore 1 awesome GitHub repository matching devops & infrastructure · Persistent Background Services. Refine with filters or upvote what's useful.
Orchest is a data pipeline orchestrator and containerized workflow manager. It provides a platform for designing, scheduling, and executing complex data processing sequences through a combination of a graphical interface and scripting. The platform distinguishes itself by using containers to manage software dependencies, ensuring consistent execution across different environments. It features a polyglot task scheduler capable of triggering jobs written in multiple programming languages and includes a version control system that tracks historical snapshots of project configurations and code.
Launches persistent background services that remain active for the entire duration of a pipeline execution.