2 Repos
Compares a model's predicted actions against ground-truth data from a dataset to compute error metrics and generate diagnostic plots.
Distinct from Robotic Policy Evaluators: Distinct from Robotic Policy Evaluators: focuses on open-loop evaluation, not hardware-in-the-loop.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Open-Loop Evaluations. Refine with filters or upvote what's useful.
Performs open-loop evaluation of robot policies against datasets.
AgiBot-World is a suite of software pipelines and tools designed for robotic policy training, dataset standardization, embodiment transfer, and performance benchmarking. It provides infrastructure for developing bimanual manipulation policies using foundation models and human-reference trajectory data. The project features a robot embodiment transfer suite that adapts pre-trained models to different robot bodies without requiring new multi-embodiment training data. It also includes a specialized evaluation framework for validating vision-language-action models through open-loop testing and ph
Includes a pipeline to replay recorded actions and measure policy accuracy before real-world hardware execution.