Awesome GitHub RepositoriesData Flow Orchestrators

Appsmith is a low-code platform designed for building internal business tools, such as operational dashboards and administrative panels. It enables developers to construct dynamic user interfaces by dragging and dropping modular widgets onto a canvas and binding them directly to backend data sources. The platform utilizes a reactive framework that automatically updates interface elements and triggers functions whenever underlying data or widget properties change, eliminating the need for manual event handling. The platform distinguishes itself through a server-side proxy architecture that exe

Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech systems. It utilizes a frame-based data pipeline to route audio, video, and text through a modular sequence of processors, enabling the orchestration of low-latency conversational AI. The project is distinguished by its ability to coordinate complex multimodal services, including speech-to-text, language models, and text-to-speech, within a single pipeline. It features semantic voice activity detection for natural turn-taking, state-machine conversation flows for dialogue manag

This project is a reference implementation of the Model-View-ViewModel pattern using Android Jetpack components. It serves as an architecture template and layering guide, dividing application code into view, domain, and data layers to ensure a unidirectional flow of dependencies. The implementation focuses on state management and configuration change handling. It demonstrates how to synchronize UI updates across multiple screens using shared state containers and preserves application state during transitions between portrait and landscape orientations. The codebase covers a broad surface of

Apache Camel 是一个企业集成框架和 Java 集成引擎，旨在在不同系统之间路由和调解数据。它作为一个多运行时中间件，实现了标准化的企业集成模式，以管理消息的路由、转换和处理方式。 该框架包含一个专用网关，利用专用通信协议将大语言模型连接到企业数据和内部系统。它利用庞大的预构建连接器库来桥接不同的通信协议，并实现不兼容软件应用程序之间的数据交换。 该系统通过消息驱动的管道支持数据流编排，允许用户通过 Java、XML、YAML 或可视化工作流设计器定义路由逻辑。这些集成流程可以作为独立服务部署，或嵌入到 Spring Boot 和 Quarkus 等宿主框架中。

GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without

Effector is a reactive state management library and data flow orchestrator designed for building complex, event-driven applications. It models application logic as a directed acyclic graph, where state updates and asynchronous side effects propagate automatically through declarative pipelines. By decoupling business logic from user interface layers, it allows developers to maintain state in independent containers that communicate via standard interfaces, ensuring the system remains framework-agnostic. The library distinguishes itself through its robust support for isolated execution scopes, w

Streem 是一种基于流的编程语言和数据流水线编排器。它提供了一种用于定义并发数据流的领域特定语言（DSL），允许用户通过一系列转换和过滤单个流元素的运算，将数据源链接到目的地。 该系统使用自定义脚本语法来定义数据流连接和流水线定义。这允许编排并发数据处理，其中多个流水线阶段同时执行，以在系统中移动数据元素。 该平台涵盖函数式数据转换和基于阶段的组合，在项目通过链接运算的顺序链时应用特定函数来修改或过滤项目。

docetl is an AI-powered document ETL tool and map-reduce orchestrator designed to transform large collections of unstructured documents into structured, queryable tables using language models. It provides a declarative pipeline framework for extracting, cleaning, and transforming data from sources such as PDFs and text files into predefined schemas. The project distinguishes itself through a semantic data integration suite that enables joining datasets and resolving duplicate entities based on embedding-based similarity. It includes an interactive prompt playground for developing and optimizi