How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Voyager is an autonomous embodied agent and lifelong learning framework that uses a large language model to explore virtual environments. It functions as a code-based action controller, translating natural language instructions into executable scripts to interact with its surroundings. The system features an automatic curriculum generator that creates sequences of exploration goals to discover new items and behaviors without human intervention. It maintains a skill library manager that stores learned behaviors as reusable code fragments, which can be composed to execute complex tasks. The fr
Habitat-Lab is an open-source platform for training and evaluating embodied AI agents in photorealistic 3D indoor environments. It functions as a high-performance 3D indoor environment simulator that supports physics-based interaction, enabling research into navigation and manipulation tasks. The platform provides a modular task-environment abstraction that separates task logic from environment simulation, using configuration-driven pipeline assembly to compose simulation and training pipelines. It includes a hierarchical sensor-actuator architecture for mixing and matching perception and act
An Embodied Generalist Agent in 3D World
The main features of embodied-generalist/embodied-generalist are: 3D Scene Understanding, Embodied Agents, Embodied Agents and Tools, Reasoning and Perception.
Projects with overlapping indexed features include: minedojo/voyager — Voyager is an autonomous embodied agent and lifelong learning framework that uses a large language model to explore… facebookresearch/habitat-lab — Habitat-Lab is an open-source platform for training and evaluating embodied AI agents in photorealistic 3D indoor… allenai/holodeck. baaivision/uni3d — Uni3D: Exploring Unified 3D Representation at Scale. changanvr/awesome-embodied-vision — Reading list for research topics in embodied vision. anjiecheng/spatialrgpt — arxiv / Huggingface.
