Awesome GitHub RepositoriesData Flow Definitions

Storm is a distributed stream processing framework designed to execute unbounded computations across a cluster to process real-time data streams. It functions as a data pipeline orchestrator that allows users to define and deploy declarative data flow graphs connecting streaming sources to processing components. The system operates as a multi-tenant distributed compute engine that isolates workloads and limits resource usage across shared clusters using dedicated pools and access control. It is also a secure distributed processing engine that employs encrypted node communication and SSL-secur

Effector is a reactive state management library and data flow orchestrator designed for building complex, event-driven applications. It models application logic as a directed acyclic graph, where state updates and asynchronous side effects propagate automatically through declarative pipelines. By decoupling business logic from user interface layers, it allows developers to maintain state in independent containers that communicate via standard interfaces, ensuring the system remains framework-agnostic. The library distinguishes itself through its robust support for isolated execution scopes, w

Streem es un lenguaje de programación basado en flujos y orquestador de pipelines de datos. Proporciona un lenguaje específico de dominio para definir flujos de datos concurrentes, permitiendo a los usuarios vincular fuentes de datos a destinos a través de una secuencia de operaciones que transforman y filtran elementos de flujo individuales. El sistema utiliza una sintaxis de script personalizada para definir conexiones de flujo de datos y definiciones de pipeline. Esto permite la orquestación del procesamiento de datos concurrente donde múltiples etapas del pipeline se ejecutan simultáneamente para mover elementos de datos a través del sistema. La plataforma cubre la transformación funcional de datos y la composición basada en etapas, aplicando funciones específicas para modificar o filtrar elementos a medida que pasan a través de una cadena secuencial de operaciones vinculadas.