FoundationVision/ByteTrack
ByteTrack
ByteTrack is a multi-object tracking framework that implements the ByteTrack algorithm, an ECCV 2022 method designed to recover occluded objects and reduce trajectory fragmentation. The core innovation of the project is its association algorithm, which processes every detection box—including low-confidence ones—by using separate high and low score thresholds, Kalman filter motion prediction, and Hungarian algorithm matching to produce consistent object identities across video frames.
The project distinguishes itself by its comprehensive approach to handling occlusions and fragmented trajectories through low-score detection recovery, where low-confidence detections are re-matched with unmatched tracklets. It includes a complete tracklet lifecycle management system that creates, updates, and deletes tracklets based on association results and a configurable maximum lost frame count. ByteTrack also provides model export capabilities, allowing trained tracking models to be converted to ONNX, TensorRT, ncnn, or DeepStream formats for production inference deployment.
The framework supports custom tracker training through a fine-tuning pipeline for adapting pretrained detectors to custom multi-object tracking datasets. It processes video files frame by frame, integrating detection results from any object detector to produce bounding boxes and tracked object identities as output. The project includes ONNX model export and TensorRT inference optimization with FP16 quantization for low-latency GPU inference.
Features
- Video Object Tracking - Tracks multiple objects across video frames by associating all detection boxes to maintain consistent identities.
- Detector-Agnostic Tracking Integrations - Integrates detection results from any object detector into the tracking algorithm for consistent object identities.
- Detection-to-Track Association - Implements the ByteTrack association algorithm that matches every detection box to existing track IDs.
- ByteTrack Association Algorithms - Implements the ByteTrack ECCV 2022 algorithm that recovers occluded objects by associating all detection boxes.
- Detector-Agnostic Trackers - Accepts detection results from any object detector and feeds them into the association algorithm for tracking.
- Detector Integrations - Accepts detection results from any object detector and feeds them into the tracking association algorithm.
- Occlusion Recovery - Recovers occluded objects by re-matching low-confidence detections with unmatched tracklets.
- Detection-to-Tracklet Association Algorithms - Implements the core ByteTrack association algorithm that matches all detection boxes to tracklets.
- Hungarian Matching Losses - Uses Hungarian algorithm bipartite matching to assign detections to tracklets with minimal cost.
- Object Tracking Frameworks - Associates every detection box across video frames to produce consistent object identities, including low-confidence ones.
- Linear Motion Models - Employs Kalman filter linear motion models to predict object positions between video frames.
- Video Frame Processing - Processes video files frame by frame to output bounding boxes and tracked object identities.
- Tracking Model Fine-Tuning Pipelines - Provides a pipeline to fine-tune pretrained detectors on custom multi-object tracking datasets.
- Dual Detection Thresholds - Ships a dual-threshold strategy that processes both high- and low-confidence detections for robust tracking.
- ONNX Model Exporters - Exports trained tracking models to the ONNX format for cross-platform inference deployment.
- Tracking Model ONNX Exporters - Exports tracking models to ONNX, TensorRT, ncnn, and DeepStream formats for production deployment.
- Tracking Model TensorRT Optimizations - Compiles tracking models into TensorRT engines with FP16 quantization for low-latency GPU inference.
- Tracking Model Fine-Tuning Pipelines - Provides a pipeline to fine-tune pretrained detectors on custom multi-object tracking datasets.
- Tracklet Lifecycle Managers - Manages the full lifecycle of tracklets including creation, update, and deletion based on association results.
- Model Export Formats - Exports tracking models to ONNX, TensorRT, ncnn, and DeepStream formats for production inference.
