# salesforce/albef

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/salesforce-albef).**

0 stars · 0 forks

## Links

- GitHub: https://github.com/salesforce/ALBEF
- awesome-repositories: https://awesome-repositories.com/repository/salesforce-albef.md

## Description

This is the official PyTorch implementation of the ALBEF paper [Blog] . This repository supports pre-training on custom datasets, as well as finetuning on VQA, SNLI-VE, NLVR2, Image-Text Retrieval on MSCOCO and Flickr30k, and visual grounding on RefCOCO+. Pre-trained and finetuned checkpoints…

## Tags

### Part of an Awesome List

- [Multimodal Pretraining](https://awesome-repositories.com/f/awesome-lists/ai/multimodal-pretraining.md) — Vision and language learning using momentum distillation.
- [Vision Language Models](https://awesome-repositories.com/f/awesome-lists/ai/vision-language-models.md) — Momentum distillation for vision and language representation learning.