30 open-source projects similar to alinlab/selfpatch, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.
Position Prediction as an Effective Pretraining Strategy
This repository includes the official project for the paper: TransMix: Attend to Mix for Vision Transformers, CVPR 2022
iBOT :robot:: Image BERT Pre-Training with Online Tokenizer (ICLR 2022)
(CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
ICCV 23This is a Pytorch implementation of our paper "SMMix: Self-Motivated Image Mixing for Vision Transformers"
NeurIPS 2021 Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learning
This is a offical PyTorch/GPU implementation of SupMAE.
ICCV 2023The PyTorch implementation of TL-Align: Token-Label Alignment for Vision Transformers.
Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".
Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
This project is a PyTorch vision transformer framework designed for self-supervised learning. It implements a model that trains visual representations using a momentum teacher and self-distillation without the need for labeled data. The library functions as an image feature extractor and visual attention visualizer, allowing for the generation of high-dimensional vectors and the rendering of self-attention maps as heatmaps or videos to analyze model focus. It provides comprehensive tools for downstream vision evaluation, including linear probe classification, k-nearest neighbor categorizatio
Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ
This is a PyTorch library and framework for self-supervised vision learning. It provides an implementation of masked autoencoders and vision transformers designed to learn image representations by reconstructing masked image patches from unlabeled data. The project features a distributed training pipeline that scales workloads across multiple GPU nodes. This infrastructure includes multi-node orchestration and gradient accumulation to manage large batch sizes and coordinate resource requests across clusters. The toolkit covers a complete workflow from self-supervised masked pre-training to d
Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496
Code release for SLIP Self-supervision meets Language-Image Pre-training
🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer Official, ICLR 2023
ECCV 2022 What to Hide from Your Students: Attention-Guided Masked Image Modeling
Official repository for "Self-supervised Models are Good Teaching Assistants for Vision Transformers", ICML 2022.
Learning from synthetic data - code and models
NeurIPS'23 DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
CVPR'23 & TPAMI'25 Hard Patches Mining for Masked Image Modeling & Bootstrap Masked Visual Modeling via Hard Patch Mining
CVPR 2023 RILS: Masked Visual Reconstruction in Language Semantic Space (https://arxiv.org/abs/2301.06958)
Official PyTorch implementation of the paper "DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training".
This is the official code release for our work, Denoising Vision Transformers.
CVIU 2025 Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training