Vehicle sensor processing

Apollo is a comprehensive software stack designed for autonomous vehicle development, providing the necessary components for perception, planning, and control. It functions as a high-performance robotics middleware, utilizing a publish-subscribe data bus to facilitate low-latency communication between distributed modules and hardware sensors. The platform integrates data from cameras, lidar, and radar through a sensor fusion framework to generate a real-time environmental model for navigation. The system features a component-based runtime framework that manages task scheduling and resource al

VINS-Fusion is a multi-sensor fusion framework and visual-inertial odometry system. It integrates camera images, inertial measurement unit data, and global positioning signals through a non-linear optimization system to track the position and orientation of autonomous vehicles. The system includes a visual loop closure engine that utilizes a bag-of-words approach to recognize previously visited locations and correct trajectory drift. It further provides tools for online spatio-temporal calibration to determine the physical offset and time synchronization between cameras and inertial sensors d

Autoware is a modular autonomous driving stack and open-source platform for advanced driver assistance systems. It functions as an integrated operating environment that manages the full pipeline from sensor data processing to vehicle actuation, utilizing the ROS 2 robotics framework for distributed communication and hardware abstraction. The system provides a comprehensive software architecture to enable autonomous driving across various vehicle platforms. It coordinates perception, planning, and control systems to operate vehicles without human intervention. The platform covers several core

PCDet is a LiDAR 3D object detection toolbox and point cloud processing library built on the PyTorch deep learning framework. It provides a system for identifying and locating three-dimensional objects within point cloud data. The project utilizes a data-model separation pattern to decouple dataset loading logic from the core detection pipeline. It features a multi-sensor fusion pipeline that combines data from multiple sensors into a shared spatial view and a distributed GPU training system to scale workloads across multiple graphics processors. The toolkit covers several capability areas,

FAST-LIVO2 is a LiDAR-inertial odometry framework and factor-graph SLAM implementation designed for real-time robot localization and 3D mapping. It functions as a multi-sensor fusion pipeline and state estimator that integrates LiDAR, inertial, and camera inputs to track a robot's position and orientation. The system employs a tightly-coupled sensor fusion approach to maintain stable navigation, particularly in degraded environments. It utilizes a voxel-based 3D mapping tool to organize point clouds into volumetric grids, which optimizes memory usage and search speed during spatial reconstruc

Dora is a robotics dataflow framework and distributed orchestrator used to build and manage processing pipelines. It enables the deployment of robotics workloads across clusters with remote node execution and provides a real-time data pipeline for predictable performance. The system is distinguished by its support for multi-language nodes written in Rust, Python, C, or C++ that interoperate within a single dataflow. It utilizes a zero-copy shared-memory transport and columnar formats to minimize latency for large payloads, and it includes bidirectional bridges to integrate with external ecosy

Cartographer is a cross-platform robotics library and framework for simultaneous localization and mapping in 2D and 3D spaces. It functions as a real-time mapping engine that constructs environmental maps while tracking a device's position and orientation using continuous sensor data processing. The system implements real-time SLAM to generate precise maps for autonomous navigation. It utilizes a localization system that determines a device's state within a mapped environment across different hardware platforms and sensor configurations. The framework covers spatial estimation through non-li

BEVFormer is a perception framework that transforms multi-camera images into bird's-eye-view representations for autonomous driving. It functions as a multi-camera vision pipeline that integrates multiple camera streams into a single unified spatial perspective to facilitate environmental understanding. The system implements a transformer-based architecture that employs query-based feature extraction and spatiotemporal networks to aggregate spatial image features and temporal historical data. It uses recurrent temporal accumulation to maintain a persistent memory of the scene across consecuti

Autoware is an open-source autonomous driving software platform built on the robotics middleware standard. It provides a comprehensive stack for managing perception, planning, and control, enabling the development and deployment of full-stack autonomous driving software on commercial transport hardware. The platform utilizes a component-based modular architecture that organizes driving functions into isolated, interchangeable nodes. This design is supported by a hardware-abstraction layer and plugin-based sensor integration, which allow the software to interface with diverse hardware configur

Cartographer is a software library and spatial localization engine for simultaneous localization and mapping. It provides a framework for calculating the precise position and orientation of a device while concurrently generating real-time 2D and 3D representations of its environment using lidar-based data. The system implements a real-time mapping approach that uses live sensor streams to track device heading and position. It utilizes a submap-based mapping strategy to divide environments into local maps that are aligned into a global map. The project covers a range of SLAM capabilities, inc

This is an open-source autonomous driving perception pipeline that processes camera and lidar sensor data to detect, track, and fuse objects in real-world driving environments. The project integrates an end-to-end perception workflow combining sensor calibration, deep learning object detection, Kalman filter tracking, and sensor fusion for robust scene understanding. The pipeline includes camera calibration tools to remove lens distortion from raw images, deep learning model training for object classification and detection, and multi-object tracking using Kalman filters with data association

This project is a robotics software package designed for simultaneous localization and mapping, providing a framework for visual-inertial odometry and environmental mapping. It functions as a middleware-integrated library that enables autonomous mobile robots to estimate their position and orientation by processing sensor data within modular software systems. The library distinguishes itself by utilizing hardware-accelerated processing to perform feature tracking and odometry calculations on dedicated graphics hardware. It maintains spatial accuracy through graph-based optimization and statis

pointcloudset