rivet-dev/rivet
Rivet
Rivet este o infrastructură distribuită pentru gestionarea ciclului de viață, adresarea și persistența actorilor stateful și a motoarelor de execuție durabile. Oferă un sandbox de proces distribuit care execută logica aplicației în izolate ușoare, asigurând izolarea resurselor și porniri rapide (fast cold starts). Sistemul este conceput pentru a coordona operațiuni în mai mulți pași folosind cozi persistente și temporizatoare pentru a garanta finalizarea fiabilă a sarcinilor în medii distribuite.
Platforma permite în mod specific orchestrarea agenților AI stateful care mențin memorie și stare persistentă pe parcursul interacțiunilor de lungă durată și al fluxurilor de lucru complexe. Se distinge printr-un framework de sincronizare a stării prin WebSocket care leagă componentele interfeței utilizator frontend de procese stateful la distanță prin comunicare bidirecțională în timp real.
Sistemul acoperă o gamă largă de capabilități, inclusiv adresarea ierarhică a actorilor, un runtime de tip hibernate-on-idle pentru optimizarea resurselor și un strat de persistență pluggable pentru backend-uri de stocare modulare. Include, de asemenea, instrumente pentru depanarea sesiunilor active, monitorizarea stării de execuție în timp real și opțiuni de deployment automatizat pentru infrastructură edge, cloud sau privată.
Proiectul este implementat în Rust și suportă dezvoltarea de actori în mai multe limbaje.
Features
- Durable Task Orchestrators - Provides a durable orchestration substrate with state persistence and revision tracking for long-running multi-step workflows.
- Stateful Distributed Actors - Maintains application state within isolated processes that automatically persist to durable storage.
- Stateful Agent Orchestration - Provides a framework for building autonomous AI agents with persistent memory across complex multi-step workflows.
- Durable Message Processing - Uses persistent queues to process asynchronous messages reliably, guaranteeing task completion and recovery.
- Automatic State Persistence - Manages long-lived processes with in-memory state that is automatically synchronized to a database for high-performance access.
- Pluggable Storage Backends - Implements a modular persistence layer allowing the system to switch between relational databases, file systems, and key-value stores.
- AI Agent Orchestrators - Deploys isolated and secure stateful environments specifically to power autonomous AI agents and long-running workflows.
- Actor Lifecycle Management - Coordinates the activation and deactivation of actor state based on request demand and inactivity.
- Distributed Workflow Orchestrators - Coordinates complex sequences of distributed tasks while managing their persistent execution state.
- Hibernating - Serializes inactive process memory to storage to minimize resources and allow rapid resumption.
- Distributed State Management - Manages the lifecycle and addressing of stateful processes across distributed systems to ensure data durability.
- Real-time Data Subscriptions - Enables clients to listen for real-time updates from backend actors to reflect state changes in the UI.
- State Synchronization - Uses hooks to automatically synchronize user interface elements with stateful backend instances.
- Isolated Execution Sandboxes - Provides secure, resource-constrained sandboxes to execute application logic within lightweight isolates.
- Sandboxed Execution Environments - Executes application logic within secure, lightweight isolates to provide resource isolation and fast cold starts.
- Agent Execution Environments - Provides isolated runtimes specifically configured for the execution and resource management of autonomous AI agents.
- Component State Bindings - Connects user interface components to remote stateful processes to manage long-running workflows.
- Hierarchical Key Addressing - Organizes distributed stateful instances using path-based namespaces for secure communication and discovery.
- Durable Workflow Execution Engines - Coordinates multi-step operations using persistent queues and timers to guarantee reliable task completion.
- Actor State Persistence - Ensures durability of long-running processes by persisting their internal state to local or remote storage providers.
- Durable Entity Definitions - Enables the creation of durable entities with internal state and actions that trigger real-time event broadcasts.
- Real-Time State Synchronization - Integrates real-time stateful backend logic with client-side interfaces for seamless application state synchronization.
- Public API Exposure - Exposes internal stateful actor processes as secure backend endpoints for external client interaction.
- Bidirectional Streams - Establishes persistent bidirectional communication channels between clients and backend processes for live data updates.
- WebSocket State Synchronization - Establishes bidirectional WebSocket channels to synchronize frontend UI components with remote stateful backend processes in real-time.
- Actor State Querying - Allows real-time browsing and querying of the internal state databases associated with active processes and sessions.
- Workflow Progress Monitoring - Provides real-time inspection of workflow progress and state transitions for durable multi-step executions.
- Application Cloud Deployments - Automates the deployment of persistent actor-based applications by connecting source repositories to managed cloud infrastructure.
- Cloud Infrastructure Cost Optimization - Reduces operational costs and latency through idle-time suspension and strategic geographic distribution of instances.
- Distributed Edge Compute Platforms - Provides a platform for deploying resource-constrained, isolated code execution across a global network of edge nodes.
- Edge Runtime Deployment - Allows running orchestration logic on serverless edge functions to minimize latency by distributing execution closer to users.
- Air-Gapped Deployments - Provides configurations to operate the orchestration infrastructure within restricted, air-gapped network environments.
- Multi-Environment Deployments - Supports running orchestration logic across diverse environments including serverless platforms and dedicated edge functions.
- Private Infrastructure Hosting - Allows hosting the entire orchestration stack on private infrastructure for maximum control over security and data.
- Websocket Connection Managers - Maintains long-lived WebSocket communication channels using proxy configurations for stable data exchange.
- Low-Level API Interfaces - Provides direct HTTP and WebSocket access to remote processes implementing specific request-handling logic.
- Real-Time State Broadcasting - Broadcasts bidirectional data to connected clients via WebSockets for live collaborative interactions.
- HTTP Endpoint Mappings - Links backend process registries to HTTP endpoints to support standard REST methods for remote communication.
- Actor Access Control - Provides authentication and authorization mechanisms specifically for validating identities and origins when accessing stateful actor instances.
- Stateful Actor Runtimes - Enables the development of stateful actor logic using multiple programming languages to meet different performance needs.
- Recurring Task Schedulers - Supports the execution and validation of delayed or recurring operations using timers and cron jobs within a controlled environment.
- Remote Function Invocation - Invokes functions on distributed processes via client connections for stateful and stateless requests.
- Stateless Request Processing - Performs one-off requests or utility calls to backend processes without maintaining a persistent connection.
- System Activity Monitoring - Provides a centralized dashboard for tracking state changes, workflow progress, and agent events.
- Interactive State REPLs - Enables direct interaction with running code by calling actions and subscribing to events through a REPL.
- Direct Process Invocations - Provides mechanisms to invoke low-level network interfaces directly on remote actor processes.
