How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"
The main features of uclanlp/visualbert are: Cross-Modal Models, Multimodal Pretraining, Vision Language Models.
Projects with overlapping indexed features include: qwenlm/qwen2.5-vl — Qwen2.5-VL is an autoregressive multimodal transformer designed to process interleaved sequences of text and visual… salesforce/lavis — LAVIS is a multimodal large language model framework and vision-language model library. It provides tools for training… salesforce/albef — This is the official PyTorch implementation of the ALBEF paper [Blog] . This repository supports pre-training on… airsplay/lxmert — Our servers break again :(. I have updated the links so that they should work fine now. Sorry for the inconvenience.… jackroos/vl-bert — Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations". facebookresearch/imagebind — ImageBind is a multi-modal embedding model and joint representation learner that maps images, text, audio, and other…
LAVIS is a multimodal large language model framework and vision-language model library. It provides tools for training and evaluating models that integrate visual, textual, and audio data, serving as a cross-modal feature extractor and a zero-shot visual reasoning engine. The framework distinguishes itself by using frozen-backbone integration, where pretrained encoders remain non-trainable while lightweight adapter layers are updated. It employs cross-modal feature alignment to map different representations into a shared embedding space and utilizes a modular model wrapper to swap vision and
Qwen2.5-VL is an autoregressive multimodal transformer designed to process interleaved sequences of text and visual tokens. It integrates visual feature embeddings into a shared language model space to perform cross-modal reasoning and generate coherent responses or structured layout code. The project distinguishes itself through vision-language-action mapping, allowing it to perceive visual interfaces and translate that perception into actionable commands for operating digital screens and robotic hardware. It employs dynamic-resolution image encoding and temporal-frame video indexing to hand
Our servers break again :(. I have updated the links so that they should work fine now. Sorry for the inconvenience. Please let me for any further issues. Thanks! --Hao, Dec 03
Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".