Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows from single machines to large clusters. It functions as a cluster resource manager that orchestrates computational logic by representing tasks and their dependencies as directed acyclic graphs. This architecture allows the system to automate the distribution of workloads across available hardware while managing complex execution requirements. The project distinguishes itself through a lazy evaluation engine that defers data operations until they are explicitly requested, enabl
braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus engine for building fault-tolerant, replicated state machines. At its core, it manages leader election, log replication, cluster membership changes, and state machine synchronization across a cluster of nodes, ensuring strong consistency and data durability even in the face of node failures. The library distinguishes itself through a comprehensive set of mechanisms for reliable distributed coordination. It uses a randomized timeout-based leader election process with term manageme
Storm is a distributed stream processing framework designed to execute unbounded computations across a cluster to process real-time data streams. It functions as a data pipeline orchestrator that allows users to define and deploy declarative data flow graphs connecting streaming sources to processing components. The system operates as a multi-tenant distributed compute engine that isolates workloads and limits resource usage across shared clusters using dedicated pools and access control. It is also a secure distributed processing engine that employs encrypted node communication and SSL-secur
This is a Raft consensus library and distributed consensus engine implemented in Go. It provides the primitives necessary to build fault-tolerant distributed services by implementing a replicated state machine that ensures a group of servers agree on a shared system state through leader election and log replication. The project distinguishes itself through a pluggable architecture for storage backends and snapshot storage, decoupling the consensus logic from physical persistence. It includes specialized mechanisms for leadership transfer, protocol version management to support rolling upgrade
Apache Mesos este un kernel de sisteme distribuite și un manager de resurse de cluster care abstractizează CPU-ul, memoria și stocarea pe un pool de noduri. Acesta funcționează ca un orchestrator de infrastructură distribuită, oferind un strat pentru a rula mai multe framework-uri de orchestrare pe un set partajat de mașini fizice sau virtuale.
Principalele funcționalități ale apache/mesos sunt: Distributed Computing Frameworks, Two-Level Scheduling, Offer-Based Allocation, Multi-Framework Orchestration, Distributed Cluster Management, Distributed Infrastructure Orchestration, Workload Isolation, Resource Isolation.
Alternativele open-source pentru apache/mesos includ: dask/dask — Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows… apache/storm — Storm is a distributed stream processing framework designed to execute unbounded computations across a cluster to… baidu/braft — braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus… hashicorp/raft — This is a Raft consensus library and distributed consensus engine implemented in Go. It provides the primitives… ltsopensource/light-task-scheduler — Light Task Scheduler is a distributed job scheduling and workflow orchestration platform designed for managing… aurae-runtime/aurae — Aurae is a memory-safe distributed systems runtime daemon written in Rust that acts as a container and process…