How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Apache Spark is a unified distributed data processing engine designed for large-scale data analysis and computation graphs. It functions as a distributed machine learning framework, a graph processing system, a real-time stream processor, and a SQL analytics engine. The system enables the execution of distributed SQL querying, large-scale graph analysis, and real-time stream analytics across clusters of machines. It also provides a scalable environment for implementing machine learning algorithms and predictive model development on massive datasets. The engine incorporates relational query e
Apache Flink is a distributed processing engine designed for both high-throughput, low-latency data streams and finite batch workloads. It functions as a stateful stream processor and a SQL stream processing engine, providing a unified runtime to execute relational queries and event-based transformations. The system is distinguished by its ability to manage persistent operator state to ensure exactly-once processing guarantees and consistency during failures. It features specialized capabilities for complex event processing to detect temporal patterns and handles out-of-order events using eve
Cocoindex is an incremental data processing engine that builds and maintains live indexes for AI agents, with a core focus on codebase indexing and knowledge graph extraction. The engine uses a function-graph execution model where user-defined Python functions are composed into a directed acyclic graph, and it processes data incrementally so only changed source records or code paths are re-computed, avoiding full recomputation at any scale. It supports automatic schema inference from transformation pipeline type annotations and provides full data lineage tracing, tagging every output record wi
Mirror of Apache Samza
The main features of apache/samza are: Stream Processing, Streaming Engines.
Projects with overlapping indexed features include: cocoindex-io/cocoindex — Cocoindex is an incremental data processing engine that builds and maintains live indexes for AI agents, with a core… emqx/kuiper — Lightweight data stream processing engine for IoT edge. apache/spark — Apache Spark is a unified distributed data processing engine designed for large-scale data analysis and computation… bytewax/bytewax — Python Stream Processing. apache/flink — Apache Flink is a distributed processing engine designed for both high-throughput, low-latency data streams and finite… hstreamdb/hstream — HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for…
