Projects sharing features with ManiSkill

Habitat-sim is a high-performance 3D simulation platform designed for training and benchmarking embodied AI agents within photorealistic indoor and outdoor environments. It serves as a simulator for AI and robotics, providing a system for generating synthetic data and simulating physical interactions. The project is distinguished by a native C++ core that enables high-throughput simulation and a rendering pipeline using physically based rendering and baked global illumination. It features a navigation system based on pre-computed navigation meshes to ensure collision-free traversal and a rigi

Unitree RL Gym is an integrated software framework designed for the simulation, training, and deployment of motion control policies for legged robotic platforms. It provides a comprehensive environment for developing locomotion strategies for quadruped and humanoid robots by leveraging reinforcement learning algorithms within high-fidelity physics-based simulations. The platform distinguishes itself by offering an end-to-end workflow that bridges the gap between virtual training and physical execution. It includes specialized tools for mapping raw sensor data into normalized state-space obser

This project is a reinforcement learning toolkit and simulation-based AI trainer for creating intelligent agents within Unity simulations. It provides a multi-agent simulation framework for configuring cooperative or competitive scenarios and includes an environment wrapper that bridges simulations with standard machine learning libraries using gym-style interfaces. The system features a native cross-platform inference engine that executes trained neural network models for real-time decision making without external dependencies. It enables the acceleration of the learning process by running m

Genesis World is an embodied AI simulation platform designed for training robotic agents through physics-based interactions. It centers on a multi-physics simulation engine that integrates rigid body, particle, and finite element method dynamics, supported by a parallel simulation kernel compiler that translates Python functions into optimized GPU and CPU kernels. The platform features a photorealistic robot renderer that utilizes path-tracing and Gaussian Splatting to generate synthetic training data. It includes a domain randomization framework to vary lighting and physical parameters acros

Isaac Lab is an open-source framework for training robot policies in physically simulated environments, supporting both single-agent and multi-agent reinforcement learning. It is built on an Omniverse-PhysX simulation backend that models rigid bodies, articulated systems, deformable objects, and sensors, and provides a task-based environment configuration system where each training environment is defined as a modular class specifying observation spaces, action spaces, reward functions, and termination conditions. The framework distinguishes itself through an RL-library abstraction layer that

CARLA is an autonomous driving simulator and research environment designed for developing and validating self-driving software. It functions as an urban traffic simulator that generates realistic vehicle and pedestrian behavior and as a synthetic sensor data generator producing LiDAR, Radar, and camera data. The platform distinguishes itself through its deep integration with robotics frameworks, specifically providing native connectivity to ROS2 nodes for robotic control and data processing. It supports the training of driving models via imitation and reinforcement learning within a controlle

Genesis is an embodied AI simulation platform and parallelized robotics simulator designed for training general-purpose robotic agents. It integrates a physics engine for robotics that calculates collisions and movements for rigid bodies, soft tissues, and fluids, alongside a photorealistic 3D rendering engine. The platform features a domain randomization framework to vary environment parameters across parallel simulations, aiding in sim-to-real transfer. It supports the integration of real-world captured light fields and Gaussian splatting to provide photorealistic backgrounds within simulat

This project is a physically based rendering system and ray tracing engine designed to generate photorealistic images. It operates as a spectral rendering system that records radiance across discretized wavelength buckets and functions as a volumetric path tracer to compute light scattering and absorption within participating media. The engine utilizes GPU acceleration to execute its rendering pipeline on parallel graphics hardware. It integrates real-world optical data, such as measured spectral power distributions and lens description files, to simulate the behavior of physical camera syste

Newton is a GPU-accelerated physics engine and robotics simulation platform designed for high-performance modeling of rigid bodies and complex articulations. It functions as a differentiable physics engine, calculating gradients to enable mathematical optimization and machine learning. The platform is distinguished by its ability to execute multiple parallel physics worlds on a single GPU, which accelerates data collection for reinforcement learning. It also supports the simulation of deformable bodies, such as cloth and cables, using particle-based methods and multi-physics coupling. Newton

RLinf is a distributed reinforcement learning orchestrator and embodied AI training framework. It provides the infrastructure to train vision-language-action models and robotic policies using a combination of reinforcement learning and supervised fine-tuning. The system is designed for scaling workloads across GPU clusters, managing the placement of actors, rollout workers, and environment components. It features a specialized robotics data collection pipeline for gathering teleoperated demonstrations and simulation trajectories into standardized replay buffers, alongside a hardware interface

AirSim is a high-fidelity simulation platform designed for the development and testing of autonomous vehicles. Built as a plugin for game engines, it provides a physics-based environment that models vehicle dynamics and sensor data, serving as a foundation for robotics research, computer vision training, and reinforcement learning. The platform distinguishes itself through its support for hardware-in-the-loop and software-in-the-loop testing, allowing developers to validate control logic and firmware against real-world signals or concurrent processes. It offers extensive programmatic control

jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

Drake is a robotics simulation framework and control system modeling tool used for designing, simulating, and verifying the dynamics of complex robotic systems. It functions as a multibody dynamics simulator and a mathematical optimization library, providing a suite of algorithms for trajectory optimization and the simulation of articulated robots. The framework is distinguished by its block-diagram system for composing dynamical subsystems and its ability to formulate and solve diverse mathematical programs, including linear, quadratic, and nonconvex nonlinear problems. It supports specializ

PhysicsJS is a JavaScript physics engine and 2D rigid body simulator designed to calculate the collisions, constraints, and dynamics of physical bodies. It functions as a modular physics library for simulating the movement and interaction of circular bodies and convex polygons. The engine implements constraint-based dynamics to enforce distance and angle constraints between objects, enabling the creation of articulated structures and linked physics. It utilizes impulse-based resolution to handle collisions and prevent objects from passing through one another. The library provides capabilitie

pysc2 is a Python interface and simulation framework that connects the StarCraft II game engine to machine learning agents. It acts as an API wrapper that exposes game internals as a set of observations and actions, providing a reinforcement learning environment for research and training. The framework includes tools for game replay analysis to extract data and sequences of actions from recorded matches for predictive modeling. It also provides an agent simulation environment to run and evaluate the performance of single or competing artificial intelligence agents. The system handles game ma

DRL-robot-navigation is a deep reinforcement learning platform and robotic simulation framework designed to train autonomous mobile robots for collision-free path planning. It uses neural network policies and physics-engine simulation environments to teach robots how to navigate toward target coordinates while avoiding obstacles. The software trains continuous control policies using twin delayed deep deterministic policy gradients over continuous state and action spaces. Training is guided by scalar reward signals derived from target proximity and obstacle avoidance distances. System compone

Gym is a reinforcement learning environment toolkit and agent simulation framework. It provides a standardized API and a universal communication interface that defines how learning agents interact with simulation environments through actions and observations. The project includes a benchmark environment suite and a diverse library of pre-configured simulation worlds, including physics engines and classic control tasks. It enables the creation of custom simulation environments to train agents in specific operational scenarios while ensuring reproducibility across different learning algorithms.

FinRL is a reinforcement learning framework designed for the development, training, and backtesting of automated trading strategies. It functions as a quantitative finance toolkit that integrates deep learning algorithms with financial market simulations to address complex portfolio management and asset allocation tasks. The platform provides an end-to-end pipeline for transforming raw market data into actionable trading models. The project distinguishes itself through a layered, modular architecture that separates data processing, environment simulation, and agent training. This design allow

Pinocchio is a multi-body dynamics engine and rigid body physics library designed for computing forward and inverse kinematics and dynamics for articulated rigid-body systems. It functions as a robot kinematics solver and model parser, enabling the analysis of complex robotic systems through kinematic and dynamic computations. The project distinguishes itself with specialized capabilities for constrained dynamics, including the calculation of contact impulses and centroidal momentum. It provides a parallel processing collision detection system for computing minimal distances between rigid bod

Video-Pre-Training is a machine learning framework designed for training autonomous agents to perform complex tasks by observing and mimicking human behavior from video recordings. It provides a comprehensive toolkit for imitation learning and reinforcement learning research, enabling the development of agents that can replicate human actions within simulated digital environments. The framework distinguishes itself through its ability to process large-scale, unlabeled video datasets to bootstrap agent capabilities. It utilizes inverse dynamics modeling to infer control inputs from frame trans

Open-AutoGLM is an autonomous agent framework designed to perform complex user workflows on mobile devices. By translating natural language instructions into precise sequences of taps, scrolls, and text inputs, the system enables the automation of mobile application interactions and testing. The platform distinguishes itself through a combination of vision-language processing and reinforcement learning. It converts graphical user interfaces into structured data, allowing agents to parse screen elements and map natural language commands to coordinate-based actions. To ensure reliability, the s

Blender is a professional 3D creation suite designed for modeling, animation, rendering, and video editing. It functions as an open-source 3D engine that provides a comprehensive framework for procedural geometry, physics simulation, and high-quality visual output. The platform is built upon a foundational architecture that utilizes data-block-based memory management and a dependency-graph-based evaluation system to handle complex scene transformations and geometry updates. The software distinguishes itself through a highly modular, node-based procedural architecture that allows users to cons

This project is an educational resource designed to teach the mathematical foundations and core algorithms of reinforcement learning. It provides a structured academic curriculum that combines textbooks, lecture materials, and practical code examples to guide learners through the principles of Markov decision processes and reinforcement learning theory. The repository distinguishes itself by integrating a grid-based simulation framework that allows users to test algorithms within custom environments. This environment supports the analysis of agent performance by rendering state values, polici

This project is a Python-based educational framework designed to simulate reinforcement learning algorithms and environments. It serves as a platform for reproducing classic textbook examples, allowing users to study agent behavior, policy improvement, and the fundamental mechanics of decision-making in controlled settings. The library provides implementations for core reinforcement learning concepts, including temporal difference learning, Monte Carlo episode sampling, and tabular value function approximation. It enables the analysis of specific algorithmic behaviors, such as identifying and

OpenMoonray is a production-grade physically based rendering system and path-tracing engine. It simulates the physical behavior of light to generate high-fidelity photorealistic images and is compatible with Universal Scene Description files for visualizing complex 3D scenes and production pipelines. The system is designed as a distributed rendering framework, capable of splitting heavy computational workloads across multiple machines or cloud clusters to accelerate image generation. It integrates OpenColorIO for consistent color management across different display devices and color spaces.

Diffusion Policy is a robot learning framework that uses diffusion models to map visual observations to precise action trajectories. It functions as an imitation learning toolkit and visuomotor policy learner, providing a system to train neural networks that replicate human behavior by generating robotic movements based on image and sensor data. The framework employs a conditional denoising process to sample sequences of robotic movements, allowing it to handle multimodal action distributions where multiple valid trajectories may exist for a single state. It utilizes score-based action modeli