17 रिपॉजिटरी
Mechanisms for saving terminal logs and output files from completed tasks to shared storage.
Distinct from Task Result Storage: Distinct from Task Result Storage: focuses on the persistence of logs and outputs for replay, rather than general workflow storage.
Explore 17 awesome GitHub repositories matching data & databases · Task Output Persistence. Refine with filters or upvote what's useful.
This project is a build orchestration engine and development toolkit designed for managing large-scale monorepos. It provides a unified workspace environment that maps project relationships and dependencies, enabling the system to perform intelligent impact analysis and execute only the tasks affected by specific code changes. The system distinguishes itself through a persistent daemon that monitors file changes for near-instant feedback and a content-addressable caching mechanism that stores task outputs to prevent redundant computation across local and remote environments. It further suppor
Shares task execution results across machines and environments to eliminate redundant work in distributed teams.
Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level
Persists internal agent task state and progress to the filesystem to ensure continuity across restarts.
Beanstalkd is a distributed work queue server designed for asynchronous job processing. It functions as a standalone server that distributes background tasks between producers and consumers to improve application responsiveness and throughput. The system organizes tasks using numeric priority levels to ensure critical work is processed first. It manages the job lifecycle through discrete states and uses a simple line-based text protocol over TCP for communication. To ensure reliability, the server persists job data to a sequential disk log, allowing the queue state to be recovered after a sy
Persists job data to disk to ensure work is not lost during server restarts or system crashes.
Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it
Merges results from multiple parallel parent tasks into a single formatted output.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Integrates a queue with an external datastore to archive items and prevent memory exhaustion by offloading data.
Acra is an Android crash reporting framework and diagnostic data collector designed to detect failures and capture device diagnostics, system logs, and application state. It serves as an embeddable library for capturing and processing crash reports, providing a pipeline to send this data to custom backends or via email. The project features a plugin-based sender architecture that allows reports to be routed through HTTP endpoints, email clients, or proprietary backend implementations. It includes a user-controlled reporting system with preference toggles and interactive dialogs to manage user
Bypasses initialization tasks when running in a separate sender process.
यह प्रोजेक्ट मल्टी-एजेंट ऑर्केस्ट्रेशन, रिट्रीवल-ऑगमेंटेड जनरेशन सिस्टम और ह्यूमन-इन-द-लूप पैटर्न के लिए संदर्भ कार्यान्वयन और टेम्प्लेट प्रदान करता है। इसमें जटिल व्यावसायिक वर्कफ़्लो और कार्यों को स्वचालित करने के लिए कई AI एजेंटों के समन्वय के लिए कार्यान्वयन पैटर्न का एक संग्रह शामिल है। यह प्रोजेक्ट प्रदर्शित करता है कि एजेंट भूमिकाओं और कार्य विनिर्देशों के लिए स्ट्रक्चर्ड टेक्स्ट फ़ाइलों का उपयोग करके सेटअप से ऑपरेशनल लॉजिक को कैसे अलग किया जाए। इसमें बाहरी ज्ञान आधारों के आधार पर प्रश्न और उत्तर प्रणाली बनाने के लिए वेक्टर सर्च और डॉक्यूमेंट प्रोसेसिंग को एकीकृत करने के लिए गाइड शामिल हैं, साथ ही स्वचालित एजेंट अनुक्रमों में मैन्युअल वैलिडेशन और समीक्षा चरण डालने के लिए पैटर्न भी शामिल हैं।
Tracks progress and context across iterative loops to maintain consistency during complex agent sequences.
Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g
Displays logs of finished tasks or follows output of running tasks in real time.
GraphQL.NET is a server-side framework for building and executing GraphQL APIs within C# applications. It provides a comprehensive toolkit for schema building, a federated engine for distributed data graphs, and a subscription handler for managing real-time data streams. The project distinguishes itself with a flexible schema builder that supports both programmatic code-first definitions and declarative schema-first approaches using the standard schema definition language. It includes a dedicated federation engine to split data graphs into subgraphs and compose them into a unified gateway, as
Retrieves execution parameters from parent nodes up to the root to share data across different levels of the resolver tree.
ZenML is an extensible machine learning orchestration framework designed to manage the end-to-end lifecycle of data pipelines and AI agent workflows. It functions as a durable orchestrator that executes machine learning tasks as directed acyclic graphs, ensuring that every step is containerized for consistent performance across local, cloud, and hybrid infrastructure. By decoupling pipeline code from underlying compute and storage backends, the platform allows developers to define infrastructure-agnostic stacks that remain portable across diverse environments. The project distinguishes itself
Automatically captures and stores step return values as artifacts using type-annotated serialization.
यह प्रोजेक्ट Flask के साथ बनाया गया एक सोशल ब्लॉगिंग एप्लिकेशन है। यह PostgreSQL रिलेशनल डेटाबेस द्वारा समर्थित यूज़र अकाउंट मैनेजमेंट, फॉलोइंग रिलेशनशिप्स और क्रोनोलॉजिकल पोस्ट स्ट्रीम के लिए एक प्लेटफ़ॉर्म प्रदान करता है। एप्लिकेशन में लोकलाइज़्ड कंटेंट और डेट फ़ॉर्मेटिंग के साथ एक बहुभाषी वेब इंटरफ़ेस है। इसे एक डॉकराइज़्ड वेब एप्लिकेशन के रूप में डिज़ाइन किया गया है, जो विभिन्न एनवायरनमेंट में कंसिस्टेंट डिप्लॉयमेंट के लिए कंटेनराइज़ेशन का उपयोग करता है। यह सिस्टम विभिन्न मुख्य क्षमताओं को एकीकृत करता है, जिसमें प्रोवाइडर एब्स्ट्रैक्शन के साथ फुल-टेक्स्ट सर्च, बैकग्राउंड प्रोसेसिंग के लिए एक एसिंक्रोनस टास्क वर्कर, और सुरक्षित रजिस्ट्रेशन और सेशन ट्रैकिंग को कवर करने वाला एक व्यापक आइडेंटिटी सिस्टम शामिल है। यह प्राइवेट मैसेजिंग, SMTP ईमेल ट्रांसमिशन और टोकन-आधारित ऑथेंटिकेशन के साथ एक API भी लागू करता है। कोडबेस राउटिंग और लॉजिक को व्यवस्थित करने के लिए एप्लिकेशन फ़ैक्टरी पैटर्न और ब्लूप्रिंट्स का उपयोग करके एक मॉड्यूलर आर्किटेक्चर अपनाता है।
Stores task identifiers and completion status in the database to track background process progress.
Moon is a monorepo build system and task runner designed to orchestrate complex projects with multiple packages. It functions as a dependency graph orchestrator that executes build targets in topological order and utilizes input hashing to cache results and skip redundant work. The project features a polyglot toolchain manager that automates the installation and versioning of language runtimes and CLI tools to ensure environment consistency. It also includes a plugin framework based on WebAssembly, allowing developers to extend build logic and toolchain behavior using any supported language.
Bundles task outputs into compressed files and unpacks them automatically during cache hits.
Good Job is a background job processor for Ruby on Rails that utilizes a PostgreSQL database as its primary storage engine. By leveraging relational database transactions, it ensures persistent and reliable task execution, integrating directly with the Active Job framework to handle asynchronous operations and recurring job scheduling within existing application environments. The system distinguishes itself through an in-process execution model that allows background workers to run within the same process as the web server, simplifying deployment by removing the need for separate worker servi
Uses relational database tables as the primary storage engine to ensure transactional integrity and persistence for all queued background tasks.
This project is a research-focused toolkit designed for building autonomous agent systems, multi-agent workflows, and security governance frameworks. It provides a platform for coordinating specialized sub-agents through structured communication protocols and phased task delegation to complete complex technical objectives. The framework distinguishes itself by integrating a dedicated security policy engine that validates autonomous tool execution against user-defined permissions and safety rules. It also features a research-oriented approach to prompt engineering, enabling the dynamic assembl
Tracks the progress and output of individual agents within a centralized state machine for multi-step workflows.
This project is a framework for managing multi-agent software development workflows built on the Model Context Protocol. It functions as an AI-driven task orchestrator that decomposes complex development objectives into atomic units, tracks their lifecycle, and coordinates specialized agents to execute, verify, and refine work. By maintaining persistent project context and history, the system ensures continuity across sessions, allowing agents to retain state and adhere to established coding standards. The system distinguishes itself through its dependency-graph task management and multi-agen
Preserves the internal state and progress of agent tasks to ensure continuity across sessions.
The rp-engine is a workflow orchestration framework designed for building and executing autonomous agentic tasks. Built in Rust, it provides a structured environment for managing complex, multi-step operations that integrate language models with external tools and data sources. The engine distinguishes itself through its native support for iterative planning loops and persistent state management. By utilizing a directed acyclic graph architecture, it coordinates sequences of tasks while maintaining a shared memory bank that updates automatically to inform future steps. The system relies on de
Saves the internal state and progress of agent tasks to ensure continuity across restarts.
Repeat is a cross-platform automation utility designed to record, replay, and script mouse and keyboard inputs. It functions as a macro scripting environment that allows users to capture raw system events and organize them into persistent sequences that remain available across application restarts. The project distinguishes itself through its ability to orchestrate tasks across multiple networked machines. By utilizing a client-server model, it synchronizes automation scripts across a local fleet, enabling coordinated execution and consistent performance on connected devices. Beyond basic in
Maintains persistent task state to ensure automation sequences remain available across application restarts.