Simclr

此项目是一个自监督对比学习框架，旨在训练深度学习模型从图像中学习视觉表示，而无需使用人类提供的标签。它提供了一个系统，用于开发可适应下游计算机视觉任务的预训练视觉表示模型。

该框架包括用于半监督图像分类的工具，它结合了大型未标记数据集和小型标记集以提高准确性。它还具有线性探测评估工具，通过在冻结的表示之上训练简单的线性分类器来评估学习到的图像特征的质量。

代码库涵盖了分布式深度学习训练和硬件加速以处理大批量数据，以及优化原语，如余弦衰减学习率调度和权重衰减正则化。它还提供了模型管理实用程序，包括在不同深度学习框架格式之间转换预训练检查点，以及用于模型部署的工具。

该实现以 Jupyter Notebooks 集合的形式提供。

Features

Visual Foundation Pre-training - Trains base networks on large image datasets using specialized hardware to create general-purpose visual representations.
Self-Supervised Vision Representation Trainers - Provides a framework for learning visual features from unlabeled image data using self-supervised contrastive techniques.
Contrastive Learning Frameworks - Provides a specialized framework for training models to learn visual representations using contrastive objectives.
Distributed Deep Learning - Implements a training setup that scales deep learning optimization across multiple compute nodes and GPUs.
Distributed GPU Training - Scales the training of contrastive learning models across multiple GPUs to support the required large batch sizes.
Linear Classifiers - Trains simple linear classifiers on top of frozen representations to evaluate the quality of learned image features.
Visual Representation Learning Frameworks - Implements a framework for learning visual representations from unlabeled images using contrastive learning.
Visual Representation Models - Develops pretrained base networks trained on large-scale image data for adaptation to downstream vision tasks.
Representation Evaluation Tools - Ships a tool for assessing the quality of learned image features using frozen weights and linear probing.
Cross-Replica Normalizations - Computes means and variances across multiple hardware cores to ensure consistent normalization during distributed training.
Pre-trained Weight Loading - Provides mechanisms for importing serialized weights of base networks and classification heads into models for immediate use.
Cosine Decay Schedules - Implements a learning rate schedule that reduces the optimization step size following a cosine curve.
Cosine Warmup Schedules - Uses a learning rate schedule that combines a warmup phase with a cosine decay curve.
Model Training Optimizers - Configures optimization algorithms like Momentum or Adam to manage weight updates during the training process.
Hardware Acceleration - Utilizes specialized GPU hardware to accelerate the mathematical computations required for large-scale model training.
Weight Decay Regularization - Applies weight-decay penalties to trainable variables to prevent overfitting during high-capacity model training.
Visual Representation Deployment - Implements functionality to load saved checkpoints for performing visual representation and classification tasks.
Semi-Supervised Classification - Combines large unlabeled datasets with small labeled sets to improve image classification accuracy.
Vision Model Fine-Tuning - Adapts general-purpose pretrained visual representation models to specific downstream tasks using labeled datasets.
Representation Model Adaptation - Adjusts pretrained representation models for specific downstream tasks using supervised learning to improve accuracy.
Advanced Learning - Simple framework for contrastive learning of visual representations.

Star 历史

google-researchsimclrArchived

Name: google-research/simclr
Author: google-research

View on GitHub

4,502 星标669 分支Jupyter NotebookApache-2.012 次浏览arxiv.org/abs/2006.10029

Simclr

该实现以 Jupyter Notebooks 集合的形式提供。

Features

Visual Foundation Pre-training - Trains base networks on large image datasets using specialized hardware to create general-purpose visual representations.
Self-Supervised Vision Representation Trainers - Provides a framework for learning visual features from unlabeled image data using self-supervised contrastive techniques.
Contrastive Learning Frameworks - Provides a specialized framework for training models to learn visual representations using contrastive objectives.
Distributed Deep Learning - Implements a training setup that scales deep learning optimization across multiple compute nodes and GPUs.
Distributed GPU Training - Scales the training of contrastive learning models across multiple GPUs to support the required large batch sizes.
Linear Classifiers - Trains simple linear classifiers on top of frozen representations to evaluate the quality of learned image features.
Visual Representation Learning Frameworks - Implements a framework for learning visual representations from unlabeled images using contrastive learning.
Visual Representation Models - Develops pretrained base networks trained on large-scale image data for adaptation to downstream vision tasks.
Representation Evaluation Tools - Ships a tool for assessing the quality of learned image features using frozen weights and linear probing.
Cross-Replica Normalizations - Computes means and variances across multiple hardware cores to ensure consistent normalization during distributed training.
Pre-trained Weight Loading - Provides mechanisms for importing serialized weights of base networks and classification heads into models for immediate use.
Cosine Decay Schedules - Implements a learning rate schedule that reduces the optimization step size following a cosine curve.
Cosine Warmup Schedules - Uses a learning rate schedule that combines a warmup phase with a cosine decay curve.
Model Training Optimizers - Configures optimization algorithms like Momentum or Adam to manage weight updates during the training process.
Hardware Acceleration - Utilizes specialized GPU hardware to accelerate the mathematical computations required for large-scale model training.
Weight Decay Regularization - Applies weight-decay penalties to trainable variables to prevent overfitting during high-capacity model training.
Visual Representation Deployment - Implements functionality to load saved checkpoints for performing visual representation and classification tasks.
Semi-Supervised Classification - Combines large unlabeled datasets with small labeled sets to improve image classification accuracy.
Vision Model Fine-Tuning - Adapts general-purpose pretrained visual representation models to specific downstream tasks using labeled datasets.
Representation Model Adaptation - Adjusts pretrained representation models for specific downstream tasks using supervised learning to improve accuracy.
Advanced Learning - Simple framework for contrastive learning of visual representations.

Simclr 的开源替代方案

相似的开源项目，按与 Simclr 的功能重合度排序。

facebookresearch/moco
facebookresearch/moco
5,136在 GitHub 上查看
moco is a PyTorch implementation of momentum contrast designed for self-supervised visual representation learning. It serves as a research-based framework for extracting high-level image features from unlabeled datasets by maximizing the similarity between different views of the same image. The system utilizes an asymmetric encoder architecture consisting of a fast-learning online encoder and a slow-evolving momentum encoder to stabilize training. It employs a dictionary-based approach that compares query images against a dynamic queue of negative samples to learn distinguishing visual featur
在 GitHub 上查看5,136
facebookresearch/jepa
facebookresearch/jepa
3,986在 GitHub 上查看
This is a PyTorch self-supervised learning framework designed to train models that learn visual representations from video. It implements a joint-embedding predictive architecture that extracts spatio-temporal features by predicting missing regions of a signal within a latent representation space rather than reconstructing raw pixels. The project includes a latent space visualization tool that uses a conditional diffusion model to decode feature-space predictions back into pixels. This allows for the verification of learned representations by transforming abstract predictions into interpretab
Python
在 GitHub 上查看3,986
open-mmlab/mmpretrain
open-mmlab/mmpretrain
3,842在 GitHub 上查看
mmpretrain is a modular PyTorch computer vision framework designed for developing, training, and benchmarking deep learning architectures. It serves as a comprehensive toolkit for vision tasks, providing a specialized platform for multimodal machine learning and self-supervised learning. The project features a computer vision model zoo containing architectural definitions and pre-trained weights for backbones such as ViT, ConvNeXt, and Swin Transformer. It distinguishes itself through a dedicated self-supervised learning toolkit that implements algorithms like MAE and DINO to train models wit
Pythonbeitclipconstrastive-learning
在 GitHub 上查看3,842
facebookresearch/mae
facebookresearch/mae
8,340在 GitHub 上查看
This is a PyTorch library and framework for self-supervised vision learning. It provides an implementation of masked autoencoders and vision transformers designed to learn image representations by reconstructing masked image patches from unlabeled data. The project features a distributed training pipeline that scales workloads across multiple GPU nodes. This infrastructure includes multi-node orchestration and gradient accumulation to manage large batch sizes and coordinate resource requests across clusters. The toolkit covers a complete workflow from self-supervised masked pre-training to d
Python
在 GitHub 上查看8,340

查看 Simclr 的所有 30 个替代方案

常见问题解答

google-research/simclr 是做什么的？

google-research/simclr 的主要功能有哪些？

google-research/simclr 的主要功能包括：Visual Foundation Pre-training, Self-Supervised Vision Representation Trainers, Contrastive Learning Frameworks, Distributed Deep Learning, Distributed GPU Training, Linear Classifiers, Visual Representation Learning Frameworks, Visual Representation Models。

google-research/simclr 有哪些开源替代品？

google-research/simclr 的开源替代品包括： facebookresearch/moco — moco is a PyTorch implementation of momentum contrast designed for self-supervised visual representation learning. It… open-mmlab/mmpretrain — mmpretrain is a modular PyTorch computer vision framework designed for developing, training, and benchmarking deep… facebookresearch/jepa — This is a PyTorch self-supervised learning framework designed to train models that learn visual representations from… facebookresearch/mae — This is a PyTorch library and framework for self-supervised vision learning. It provides an implementation of masked… facebookresearch/dino — This project is a PyTorch vision transformer framework designed for self-supervised learning. It implements a model… morvanzhou/pytorch-tutorial — This project is a collection of PyTorch learning resources and educational guides designed to teach the construction…