Awesome GitHub RepositoriesRobotic Sensor Simulation

Genesis World is an embodied AI simulation platform designed for training robotic agents through physics-based interactions. It centers on a multi-physics simulation engine that integrates rigid body, particle, and finite element method dynamics, supported by a parallel simulation kernel compiler that translates Python functions into optimized GPU and CPU kernels. The platform features a photorealistic robot renderer that utilizes path-tracing and Gaussian Splatting to generate synthetic training data. It includes a domain randomization framework to vary lighting and physical parameters acros

CARLA is an autonomous driving simulator and research environment designed for developing and validating self-driving software. It functions as an urban traffic simulator that generates realistic vehicle and pedestrian behavior and as a synthetic sensor data generator producing LiDAR, Radar, and camera data. The platform distinguishes itself through its deep integration with robotics frameworks, specifically providing native connectivity to ROS2 nodes for robotic control and data processing. It supports the training of driving models via imitation and reinforcement learning within a controlle

jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

Isaac Lab is an open-source framework for training robot policies in physically simulated environments, supporting both single-agent and multi-agent reinforcement learning. It is built on an Omniverse-PhysX simulation backend that models rigid bodies, articulated systems, deformable objects, and sensors, and provides a task-based environment configuration system where each training environment is defined as a modular class specifying observation spaces, action spaces, reward functions, and termination conditions. The framework distinguishes itself through an RL-library abstraction layer that

This project is an autonomous vehicle simulator designed to validate self-driving logic and train deep learning algorithms within a virtual environment. It functions as a training platform for developing neural networks that control vehicle movement and steering based on visual sensor data. The simulator uses the Unity game engine to provide a physics-based world where autonomous driving algorithms can be tested on virtual road courses without the use of physical hardware. The system integrates a C# scripting backend with a physics engine for collision detection and vehicle dynamics. It util

Habitat-sim is a high-performance 3D simulation platform designed for training and benchmarking embodied AI agents within photorealistic indoor and outdoor environments. It serves as a simulator for AI and robotics, providing a system for generating synthetic data and simulating physical interactions. The project is distinguished by a native C++ core that enables high-throughput simulation and a rendering pipeline using physically based rendering and baked global illumination. It features a navigation system based on pre-computed navigation meshes to ensure collision-free traversal and a rigi

mujoco_menagerie is a curated library of physical robot specifications and XML model definitions designed for standardized dynamics and contact simulation. It provides a collection of high-quality robot model files for humanoids, quadrupeds, and manipulators, alongside detailed kinematic and inertial parameters used to reproduce real-world robot behavior in virtual environments. The project serves as a repository of robotics simulation assets and MJCF model definitions optimized for accuracy. It includes standardized model libraries specifically for bipedal, quadrupedal, and humanoid hardware

Chrono is a multi-physics simulation suite that functions as a multibody dynamics simulator, a finite element analysis tool, and a robotics simulation framework. It provides specialized solvers for fluid-solid interaction and distributed physics engines capable of synchronizing multiple agents across a network. The project features a dedicated pipeline for converting CAD assemblies into simulation-ready formats and integrates directly with robot operating systems to validate autonomous control logic and sensors. It differentiates itself through the use of WebAssembly for portable browser-base

OM1 is a multimodal AI agent runtime and orchestration framework designed to connect large language models to physical robot hardware and sensors. It provides an execution environment that processes audio, video, and sensor data to drive autonomous decisions and actions in real-world settings. The system integrates a robotics SLAM and navigation stack with a hardware abstraction layer, allowing high-level AI commands to be translated into low-level motor and actuator instructions. It distinguishes itself by incorporating blockchain-based governance to enforce immutable operational rules and p

ManiSkill is a GPU-accelerated robot simulation framework designed for training robotic manipulation skills, benchmarking learning algorithms, and generating synthetic datasets. It serves as a reinforcement learning environment where robot control policies can be developed and evaluated using parallelized physics and rendering on the GPU. The platform is distinguished by its ability to perform sim-to-real transfer, allowing policies trained in virtual environments to be deployed onto physical robotic hardware. It features ray-traced parallel rendering for producing high-frame-rate RGBD and se

Newton is a GPU-accelerated physics engine and robotics simulation platform designed for high-performance modeling of rigid bodies and complex articulations. It functions as a differentiable physics engine, calculating gradients to enable mathematical optimization and machine learning. The platform is distinguished by its ability to execute multiple parallel physics worlds on a single GPU, which accelerates data collection for reinforcement learning. It also supports the simulation of deformable bodies, such as cloth and cables, using particle-based methods and multi-physics coupling. Newton