For 3d object detection, the first results are fundamentalvision/bevformer (BEVFormer is an open-source perception framework for transforming multi-camera images into bird's-eye-view representations for autonomous driving, matching the core intent despite lacking direct LiDAR processing support), sshaoshuai/pcdet (PCDet is a PyTorch-based LiDAR 3D object detection framework that supports point cloud processing, multi-sensor fusion, and distributed GPU training for locating three-dimensional objects) and open-mmlab/mmdetection3d (This toolbox provides a unified framework for 3D object detection from LiDAR and camera sensors, supporting multi-sensor fusion, bird's-eye view representations, and a PyTorch backend). maudzung/super-fast-accurate-3d-object-detection and facebookresearch/votenet round out the shortlist. Compare the match explanations and check the project documentation against your requirements.
Explore hand-picked open-source 3D object detection repositories, ranked by GitHub stars, activity, and relevance to compare the best fit.
BEVFormer is a perception framework that transforms multi-camera images into bird's-eye-view representations for autonomous driving. It functions as a multi-camera vision pipeline that integrates multiple camera streams into a single unified spatial perspective to facilitate environmental understanding. The system implements a transformer-based architecture that employs query-based feature extraction and spatiotemporal networks to aggregate spatial image features and temporal historical data. It uses recurrent temporal accumulation to maintain a persistent memory of the scene across consecuti
BEVFormer is an open-source perception framework for transforming multi-camera images into bird's-eye-view representations for autonomous driving, matching the core intent despite lacking direct LiDAR processing support.
PCDet is a LiDAR 3D object detection toolbox and point cloud processing library built on the PyTorch deep learning framework. It provides a system for identifying and locating three-dimensional objects within point cloud data. The project utilizes a data-model separation pattern to decouple dataset loading logic from the core detection pipeline. It features a multi-sensor fusion pipeline that combines data from multiple sensors into a shared spatial view and a distributed GPU training system to scale workloads across multiple graphics processors. The toolkit covers several capability areas,
PCDet is a PyTorch-based LiDAR 3D object detection framework that supports point cloud processing, multi-sensor fusion, and distributed GPU training for locating three-dimensional objects.
MMDetection3D is an open-source toolbox for 3D perception, providing a unified framework for detecting and segmenting objects in three-dimensional environments. It supports a range of core tasks including monocular 3D object detection from single camera images, LiDAR-based 3D object detection from raw point clouds, and multi-modal fusion that combines camera images with LiDAR data. The toolbox also covers point cloud semantic segmentation, assigning class labels to every point in a scan for scene understanding. The project distinguishes itself through a config-driven pipeline that orchestrate
This toolbox provides a unified framework for 3D object detection from LiDAR and camera sensors, supporting multi-sensor fusion, bird's-eye view representations, and a PyTorch backend.
Super Fast and Accurate 3D Object Detection based on 3D LiDAR Point Clouds (The PyTorch implementation)
This PyTorch-based framework focuses specifically on 3D LiDAR point cloud processing for fast and accurate object detection, though it does not cover multi-sensor fusion or monocular modalities.
Deep Hough Voting for 3D Object Detection in Point Clouds
This repository provides a PyTorch-based framework for 3D object detection using point clouds via deep Hough voting, making it a relevant tool for spatial perception tasks even though it lacks multi-sensor fusion and bird's-eye view representations.
OpenPCDet is a PyTorch deep learning library and toolbox for LiDAR 3D object detection. It functions as a point cloud processing framework designed to develop, train, and evaluate machine learning models that identify and locate objects in three dimensional space. The project includes a GPU-accelerated geometry engine for high-performance implementation of 3D intersection over union and rotated non-maximum suppression. It also provides a distributed model training tool to scale the training and testing of detection models across multiple GPUs and computing nodes. The framework covers point c
OpenPCDet is a PyTorch-based framework specifically designed for LiDAR point cloud processing and 3D object detection, though it focuses primarily on LiDAR rather than multi-sensor fusion or monocular detection.
Ultralytics is a comprehensive computer vision framework designed for training, validating, and deploying deep learning models across a wide range of visual recognition tasks. It provides a unified interface for core operations including object detection, instance segmentation, pose estimation, and image classification. By utilizing a modular architecture, the platform allows users to swap model components to balance inference speed and accuracy requirements for diverse applications. The framework distinguishes itself through its support for real-time processing and flexible deployment. It in
Ultralytics is a popular computer vision framework supporting object detection and PyTorch, but its primary focus is 2D image tasks rather than native 3D object detection, LiDAR processing, or bird's-eye-view representations.
Code release for the paper PointRCNN:3D Object Proposal Generation and Detection from Point Cloud, CVPR 2019.
This repository provides a PyTorch-based framework for 3D object detection from LiDAR point clouds, which fits the category well despite focusing primarily on single-sensor point cloud processing rather than multi-sensor fusion.
SECOND for KITTI/NuScenes object detection
This repository provides a PyTorch implementation of SECOND for 3D object detection on LiDAR point clouds, which fits the core category even though it focuses primarily on voxel-based LiDAR processing rather than multi-sensor fusion.
Group-Free 3D Object Detection via Transformers
This repository provides a PyTorch-based framework for 3D object detection using transformers, which fits the category well even though it focuses specifically on point cloud processing rather than multi-sensor fusion or bird's-eye view representations.
| Repository | Stars | Language | License | Last push |
|---|---|---|---|---|
| fundamentalvision/bevformer | 4.5K | Python | Apache-2.0 | |
| sshaoshuai/pcdet | 5.6K | Python | Apache-2.0 | |
| 6.3K |
| Python |
| apache-2.0 |
| maudzung/super-fast-accurate-3d-object-detection | 1.1K | Python | MIT |
| facebookresearch/votenet | 1.8K | Python | MIT |
| open-mmlab/openpcdet | 5.6K | Python | Apache-2.0 |
| ultralytics/ultralytics | 58.5K | Python | AGPL-3.0 |
| sshaoshuai/pointrcnn | 1.8K | Python | MIT |
| traveller59/second.pytorch | 1.8K | Python | MIT |
| zeliu98/group-free-3d | 255 | Python | MIT |