1 repository
Awesome GitHub RepositoriesData Processing Frameworks
Libraries and engines for transforming and analyzing large-scale datasets using distributed computing techniques.
Explore 1 awesome GitHub repository matching data & databases · Data Processing Frameworks. Refine with filters or upvote what's useful.
Awesome Data Processing Frameworks GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- ray-project/ray
ray-project/ray
42,895Vezi pe GitHubRay is a distributed computing framework designed to scale Python and Java applications across clusters by abstracting task scheduling and resource management. It functions as a resource-aware execution engine that manages task dependencies, placement, and fault tolerance across networked compute nodes. At its core, the system provides a stateful actor model, allowing developers to define classes that run in dedicated processes to maintain and mutate internal state across remote method calls. The framework distinguishes itself through a robust cross-language interoperability layer, enabling f
Transforming and analyzing massive datasets in parallel using lazy evaluation, distributed shuffles, and efficient memory management.
Pythondata-sciencedeep-learningdeployment
