awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
facebookresearch avatar

facebookresearch/maeArchived

0
View on GitHub↗

Mae

This is a PyTorch library and framework for self-supervised vision learning. It provides an implementation of masked autoencoders and vision transformers designed to learn image representations by reconstructing masked image patches from unlabeled data.

The project features a distributed training pipeline that scales workloads across multiple GPU nodes. This infrastructure includes multi-node orchestration and gradient accumulation to manage large batch sizes and coordinate resource requests across clusters.

The toolkit covers a complete workflow from self-supervised masked pre-training to downstream task fine-tuning. It includes capabilities for representation quality evaluation through linear probing analysis and performance metric calculation on validation datasets.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Masked Image Modeling - Implements masked image modeling to learn visual representations by predicting missing image patches.
  • Masked Autoencoding - Implements a masked autoencoder architecture for self-supervised pre-training of vision transformers via image patch reconstruction.
  • Distributed Training - Scales deep learning workloads across multiple compute nodes to handle large-scale vision datasets.
  • Data-Parallel Training - Provides distributed data-parallel training to synchronize gradients across multiple GPU nodes.
  • Distributed Training - Ships a distributed training pipeline for scaling models across multiple GPU nodes.
  • Asymmetric Encoder-Decoders - Implements an asymmetric encoder-decoder architecture to efficiently reconstruct masked image patches.
  • Image Patch Embedders - Converts images into flattened vector sequences using patch-based embedding modules.
  • Vision Transformer Pre-training - Provides a full pipeline for pre-training vision transformers using self-supervised masked modeling.
  • Masked Autoencoder Implementations - Provides a complete PyTorch implementation of masked autoencoders for vision transformers.
  • Self-Supervised Vision Representation Trainers - Trains vision transformers to learn image representations from unlabeled data using self-supervised techniques.
  • Vision Transformers - Implements a transformer architecture designed for processing image data as sequences.
  • Training Node Orchestration - Orchestrates training workloads across multiple compute nodes and GPUs using a cluster scheduler.
  • Linear Classifiers - Evaluates learned feature quality by training linear classifiers on frozen encoder embeddings.
  • Vision Model Fine-Tuning - Enables fine-tuning of pre-trained vision transformers for specific downstream tasks.
  • Representation Evaluation Tools - Assesses representation quality through linear probing and validation accuracy metrics.
  • Gradient Accumulation Strategies - Uses gradient accumulation strategies to simulate larger batch sizes on limited hardware.
  • Self-Supervised Learning - Masked autoencoder pretraining for visual representation learning.
  • Self-Supervised Pretraining - Scalable masked autoencoder framework for vision learners.
  • Vision Backbones and Classification - Scalable masked autoencoders for vision learning.
8,340 stars·1,348 forks·Python·20 views

Star history

Star history chart for facebookresearch/maeStar history chart for facebookresearch/mae

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Projects sharing features with Mae

These projects share indexed features with Mae. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • microsoft/swin-transformermicrosoft avatar

    microsoft/Swin-Transformer

    15,715View on GitHub↗

    Swin-Transformer is a deep learning framework designed for training and deploying hierarchical vision transformer models. It serves as a research library and toolkit for computer vision tasks, providing the infrastructure to build models that replace standard convolution operations with sliding window self-attention mechanisms. By utilizing a multi-scale feature hierarchy, the framework enables the processing of visual data at varying resolutions and spatial scales. The project distinguishes itself through its implementation of shifted window partitioning, which facilitates global information

    Pythonade20kimage-classificationimagenet
    View on GitHub↗15,715
  • lightly-ai/lightlylightly-ai avatar

    lightly-ai/lightly

    3,831View on GitHub↗

    Lightly is a self-supervised learning framework and computer vision data curation tool designed to manage large image datasets and train models on unlabeled data. It functions as a PyTorch vision library and dataset management SDK, providing tools to convert raw images into high-dimensional vectors for similarity search, visualization, and feature extraction. The project implements a variety of self-supervised architectures, including MoCo, SimCLR, VICReg, Barlow Twins, and masked image modeling. It distinguishes itself by combining these learning frameworks with active learning capabilities,

    Pythoncomputer-visioncontrastive-learningcontributions-welcome
    View on GitHub↗3,831
  • facebookresearch/dinofacebookresearch avatar

    facebookresearch/dino

    7,592View on GitHub↗

    This project is a PyTorch vision transformer framework designed for self-supervised learning. It implements a model that trains visual representations using a momentum teacher and self-distillation without the need for labeled data. The library functions as an image feature extractor and visual attention visualizer, allowing for the generation of high-dimensional vectors and the rendering of self-attention maps as heatmaps or videos to analyze model focus. It provides comprehensive tools for downstream vision evaluation, including linear probe classification, k-nearest neighbor categorizatio

    Python
    View on GitHub↗7,592
  • facebookresearch/dinov3facebookresearch avatar

    facebookresearch/dinov3

    11,706View on GitHub↗

    This project is a self-supervised vision foundation model based on a vision transformer architecture. It is designed to learn dense visual representations from unlabeled images, serving as a general-purpose backbone for a wide variety of downstream vision tasks. The system is distinguished by its use of self-distillation and masked image modeling to extract semantic and geometric features. It also incorporates an image-text alignment model that maps visual embeddings to textual descriptions, enabling zero-shot image recognition, zero-shot segmentation, and cross-modal retrieval. The project

    Jupyter Notebook
    View on GitHub↗11,706
Compare all 30 related projects→

Frequently asked questions

What does facebookresearch/mae do?

This is a PyTorch library and framework for self-supervised vision learning. It provides an implementation of masked autoencoders and vision transformers designed to learn image representations by reconstructing masked image patches from unlabeled data.

What are the main features of facebookresearch/mae?

The main features of facebookresearch/mae are: Masked Image Modeling, Masked Autoencoding, Distributed Training, Data-Parallel Training, Asymmetric Encoder-Decoders, Image Patch Embedders, Vision Transformer Pre-training, Masked Autoencoder Implementations.

Which projects share features with facebookresearch/mae?

Projects with overlapping indexed features include: microsoft/swin-transformer — Swin-Transformer is a deep learning framework designed for training and deploying hierarchical vision transformer… lightly-ai/lightly — Lightly is a self-supervised learning framework and computer vision data curation tool designed to manage large image… facebookresearch/dino — This project is a PyTorch vision transformer framework designed for self-supervised learning. It implements a model… facebookresearch/dinov3 — This project is a self-supervised vision foundation model based on a vision transformer architecture. It is designed… open-mmlab/mmpretrain — mmpretrain is a modular PyTorch computer vision framework designed for developing, training, and benchmarking deep… microsoft/unilm — This project is a comprehensive framework and toolkit for developing, optimizing, and deploying transformer-based…