How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Qwen2-VL is a multimodal large language model and vision language model designed to process and reason across text, images, and video content. It functions as a visual reasoning engine and a visual agent framework, capable of interpreting visual data to perform object detection, document parsing, and spatial reasoning. The model is distinguished by its ability to act as a video understanding model, processing hour-long videos with second-level indexing and event recall. It further differentiates itself through a visual agent capability that interacts with software interfaces and robotic hardw
This repository contains the code for training and evaluating the various models presented in the paper IQA: Visual Question Answering in Interactive Environments. It also provides an interface for reading the questions and generating new questions if desired.
We present ManipulaTHOR , a framework that facilitates visual manipulation of objects using a robotic arm. Our framework is built upon a physics engine and enables realistic interactions with objects while navigating through scenes and performing tasks. Object manipulation is an established…
A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox CVPR 2020
The main features of askforalfred/alfred are: Simulation Frameworks, Visual Interactions.
Projects with overlapping indexed features include: qwenlm/qwen2-vl — Qwen2-VL is a multimodal large language model and vision language model designed to process and reason across text,… arnold-benchmark/arnold. danielgordon10/thor-iqa-cvpr-2018 — This repository contains the code for training and evaluating the various models presented in the paper IQA: Visual… facebookresearch/habitat-sim — Habitat-sim is a high-performance 3D simulation platform designed for training and benchmarking embodied AI agents… genesis-embodied-ai/genesis — Genesis is an embodied AI simulation platform and parallelized robotics simulator designed for training… allenai/manipulathor — We present ManipulaTHOR , a framework that facilitates visual manipulation of objects using a robotic arm. Our…