3 مستودعات
A platform that combines vision-language-action models with whole-body controllers to generate coordinated joint commands for humanoid robots from language and image inputs.
Distinct from Humanoid Coordination: Distinct from Humanoid Coordination: focuses on vision-language-action models for control rather than general whole-body coordination systems.
Explore 3 awesome GitHub repositories matching hardware & iot · Vision-Language-Action Controllers. Refine with filters or upvote what's useful.
Combines vision-language-action models with whole-body controllers to generate coordinated joint commands for humanoid robots.
OpenVLA is a vision-language-action model and framework designed for general-purpose robotic manipulation. It provides a robotic policy training framework and a control inference engine that map visual and textual inputs to robotic control actions, enabling zero-shot instruction following on hardware. The project includes a robotics dataset pipeline for standardizing diverse trajectory data and managing dataset mixtures. It supports large-scale model training through distributed GPU compute and sharded data parallelism, alongside parameter-efficient adaptation for fine-tuning models to new ta
Generates precise robotic control actions by processing combined visual and textual inputs through a trained VLA model.
RLinf is a distributed reinforcement learning orchestrator and embodied AI training framework. It provides the infrastructure to train vision-language-action models and robotic policies using a combination of reinforcement learning and supervised fine-tuning. The system is designed for scaling workloads across GPU clusters, managing the placement of actors, rollout workers, and environment components. It features a specialized robotics data collection pipeline for gathering teleoperated demonstrations and simulation trajectories into standardized replay buffers, alongside a hardware interface
Maps visual observations and language prompts to continuous robotic control commands using VLM backbones.