Projects sharing features with Alfworld

jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

Qwen2-VL is a multimodal large language model and vision language model designed to process and reason across text, images, and video content. It functions as a visual reasoning engine and a visual agent framework, capable of interpreting visual data to perform object detection, document parsing, and spatial reasoning. The model is distinguished by its ability to act as a video understanding model, processing hour-long videos with second-level indexing and event recall. It further differentiates itself through a visual agent capability that interacts with software interfaces and robotic hardw

This project is an AI research implementation library and machine learning research repository. It provides a collection of reference code, illustrative implementations, and open-source research datasets used to verify hypotheses and build upon existing models in artificial intelligence. The repository focuses on scientific research reproduction by translating theoretical findings from published papers into executable code. It includes specialized scientific simulation environments designed to test the behavior of autonomous agents and models within controlled settings. The project covers AI

👉 CARLA resources such as tutorial, blog, code and etc https://github.com/carla-simulator/carla

ScienceWorld

We introduce ReCall, a novel framework that trains LLMs to Reason with Tool Call via reinforcement learning—without requiring any supervised data on tool use trajectories or reasoning steps. ReCall empowers LLMs to agentically use and combine arbitrary tools like OpenAI o3, offering an…

A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox CVPR 2020

Generate random crop fields for Ignition Gazebo

Code for the paper Learning Latent Dynamic Robust Representations for World Models (ICML-24).

We introduce Enigmata, the first comprehensive suite tailored for improving LLMs with puzzle reasoning skills, which integrates seamlessly with reinforcement learning using verifiable rule-based rewards.

CARLA is an autonomous driving simulator and research environment designed for developing and validating self-driving software. It functions as an urban traffic simulator that generates realistic vehicle and pedestrian behavior and as a synthetic sensor data generator producing LiDAR, Radar, and camera data. The platform distinguishes itself through its deep integration with robotics frameworks, specifically providing native connectivity to ROS2 nodes for robotic control and data processing. It supports the training of driving models via imitation and reinforcement learning within a controlle

Unreal Engine Plugin to enable ROS Support

robosuite: A Modular Simulation Framework and Benchmark for Robot Learning

An OpenAI gym wrapper for CARLA simulator

MIT Cheetah I Implementation

[Homepage](https://robomimic.github.io/)   [Documentation](https://robomimic.github.io/docs/introduction/overview.html)   [Study Paper](https://arxiv.org/abs/2108.03298)   [Study Website](https://robomimic.github.io/study/)   [[ARISE…

Support for ROS-enabled RGBD data acquisition in Unreal Engine Projects

V-D4RL provides pixel-based analogues of the popular D4RL benchmarking tasks, derived from the dmcontrol suite, along with natural extensions of two state-of-the-art online pixel-based continuous control algorithms, DrQ-v2 and DreamerV2, to the offline setting. For further details, please see…

Webots is a physics-based robot simulator and development environment used for modeling, programming, and testing the behavior of robots in a simulated 3D physical world. It serves as a virtual prototyping tool to verify mechanical and electronic systems through the creation of virtual robot models and control logic. The platform enables a full robotics simulation workflow, including the development of robot controllers and the programming of autonomous agent behaviors. It focuses on physical system modeling to represent the mechanical properties of hardware and simulate real-world interactio

This repository contains the code for training and evaluating the various models presented in the paper IQA: Visual Question Answering in Interactive Environments. It also provides an interface for reading the questions and generating new questions if desired.

Status: Stable release

Deep Hierarchical Planning from Pixels

Deepdrive is a simulator that allows anyone with a PC to push the state-of-the-art in self-driving

G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning

ROS bridge for CARLA Simulator

Cloe

This package contains implementations of various RL algorithms for continuous control tasks simulated with MuJoCo.