2 repository-uri
Awesome GitHub RepositoriesData-Locality Scheduling
Systems that optimize performance by scheduling computation on the physical node where the data is stored.
Distinct from Local Data Engines: None of the candidates describe moving computation to data to minimize network traffic; they focus on local storage or channel scheduling.
Explore 2 awesome GitHub repositories matching data & databases · Data-Locality Scheduling. Refine with filters or upvote what's useful.
Awesome Data-Locality Scheduling GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- apache/hadoop
apache/hadoop
15,567Vezi pe GitHubHadoop is a big data infrastructure suite and distributed data processing framework designed to store and process massive datasets across clusters of computers. It consists of a distributed storage system for managing large files across multiple nodes and a parallel computing engine for processing data across a distributed cluster. The framework implements a distributed file system to ensure fault tolerance and high throughput, paired with a programming model that processes large datasets in parallel. It manages the underlying hardware and software environment required for distributed big dat
Implements scheduling that minimizes network traffic by executing logic on the physical node where the required data resides.
Java - openebs/openebs
openebs/openebs
9,771Vezi pe GitHubOpenEBS is a container-native storage platform that provides persistent volumes for stateful applications running on Kubernetes. It operates through a Kubernetes-native microservice architecture, where storage controllers are managed entirely with kubectl and standard Kubernetes APIs, and offers both local and replicated block storage options. The platform distinguishes itself through synchronous NVMe-TCP replication, which replicates block data across nodes to enable pod rescheduling after node failure without data loss. It also includes a snapshot and clone engine for capturing point-in-tim
Places pods onto nodes with sufficient local storage capacity for the requested persistent volume.
block-storageblockstoragecloud-native
