Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows from single machines to large clusters. It functions as a cluster resource manager that orchestrates computational logic by representing tasks and their dependencies as directed acyclic graphs. This architecture allows the system to automate the distribution of workloads across available hardware while managing complex execution requirements. The project distinguishes itself through a lazy evaluation engine that defers data operations until they are explicitly requested, enabl
braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus engine for building fault-tolerant, replicated state machines. At its core, it manages leader election, log replication, cluster membership changes, and state machine synchronization across a cluster of nodes, ensuring strong consistency and data durability even in the face of node failures. The library distinguishes itself through a comprehensive set of mechanisms for reliable distributed coordination. It uses a randomized timeout-based leader election process with term manageme
Storm is a distributed stream processing framework designed to execute unbounded computations across a cluster to process real-time data streams. It functions as a data pipeline orchestrator that allows users to define and deploy declarative data flow graphs connecting streaming sources to processing components. The system operates as a multi-tenant distributed compute engine that isolates workloads and limits resource usage across shared clusters using dedicated pools and access control. It is also a secure distributed processing engine that employs encrypted node communication and SSL-secur
This is a Raft consensus library and distributed consensus engine implemented in Go. It provides the primitives necessary to build fault-tolerant distributed services by implementing a replicated state machine that ensures a group of servers agree on a shared system state through leader election and log replication. The project distinguishes itself through a pluggable architecture for storage backends and snapshot storage, decoupling the consensus logic from physical persistence. It includes specialized mechanisms for leadership transfer, protocol version management to support rolling upgrade
Apache Mesos 是一个分布式系统内核和集群资源管理器,抽象了节点池中的 CPU、内存和存储。它作为一个分布式基础设施编排器,提供了一个在共享物理或虚拟机器集上运行多个编排框架的层。
apache/mesos 的主要功能包括:Distributed Computing Frameworks, Two-Level Scheduling, Offer-Based Allocation, Multi-Framework Orchestration, Distributed Cluster Management, Distributed Infrastructure Orchestration, Workload Isolation, Resource Isolation。
apache/mesos 的开源替代品包括: dask/dask — Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows… apache/storm — Storm is a distributed stream processing framework designed to execute unbounded computations across a cluster to… baidu/braft — braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus… ltsopensource/light-task-scheduler — Light Task Scheduler is a distributed job scheduling and workflow orchestration platform designed for managing… hashicorp/raft — This is a Raft consensus library and distributed consensus engine implemented in Go. It provides the primitives… linkedin/school-of-sre — This project is a comprehensive educational resource and curriculum focused on site reliability engineering,…