1 Repo
Scaling self-supervised vision model training across multiple GPU nodes using data parallelism.
Distinct from Core Pre-Training: No candidates cover the distributed infrastructure aspect of vision pre-training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Distributed Vision Pre-training. Refine with filters or upvote what's useful.
This project is a self-supervised vision foundation model based on a vision transformer architecture. It is designed to learn dense visual representations from unlabeled images, serving as a general-purpose backbone for a wide variety of downstream vision tasks. The system is distinguished by its use of self-distillation and masked image modeling to extract semantic and geometric features. It also incorporates an image-text alignment model that maps visual embeddings to textual descriptions, enabling zero-shot image recognition, zero-shot segmentation, and cross-modal retrieval. The project
Provides tools for distributed vision pre-training on GPU clusters to process massive unlabeled image sets.