1 Repo
Systems that provision and allocate compute resources specifically for distributed data flow topologies.
Distinct from Cluster Resource Managers: Distinct from general HPC Cluster Resource Managers: focuses on the dynamic allocation of workers for stream processing DAGs rather than batch scientific workloads
Explore 1 awesome GitHub repository matching scientific & mathematical computing · Stream Processing Resource Managers. Refine with filters or upvote what's useful.
Storm is a distributed stream processing framework and fault-tolerant compute engine designed for executing real-time continuous computations across a cluster of machines. It functions as a stateful stream processor and cluster topology manager, enabling the deployment and monitoring of distributed data flow configurations. The system ensures exactly-once semantics by utilizing transactional state management to guarantee that every message in a data stream is processed exactly one time. It further operates as a distributed RPC system, allowing for the integration of non-native languages throu
Provides mechanisms to assign specific hardware to data flows and monitor throughput for resource isolation.