1 Repo
Tools for sharing and managing common datasets used for machine learning benchmarks.
Distinct from Reactive Data Sharing: Distinct from reactive data sharing: focuses on collaborative dataset repositories rather than reactive object sharing.
Explore 1 awesome GitHub repository matching data & databases · Collaborative Benchmarking. Refine with filters or upvote what's useful.
Datasets is a library designed for the management, processing, and sharing of large-scale data collections for machine learning workflows. It functions as both a data processing framework and a versioning platform, providing tools to organize, filter, and transform massive datasets while ensuring reproducibility across research and development teams. The library distinguishes itself by enabling the handling of datasets that exceed available system memory. It utilizes memory-mapped file access, disk-based caching, and lazy iterative streaming to maintain performance when working with large-sca
Facilitates team collaboration on machine learning benchmarks through shared data repositories.