Abstract:Three-dimensional multimodality multi-object tracking has attracted great attention due to the use of complementary information. However, such a framework generally adopts a one-stage association approach, which fails to perform precise matching between detections and tracklets, and, thus, cannot robustly track objects in complex scenes. To address this matching problem caused by one-stage association, we propose a novel multi-stage association method, which consists of a hierarchical matching module and a customized track management module. Specifically, the hierarchical matching module defines the reliability of the objects by associating multimodal detections, and matches detections with trajectories based on the reliability in turn, which increases the utilization of true detections, and, thus, guides accurate association. Then, based on the reliability of the trajectories provided by the matching module, the customized track management module sets maximum missing frames with differences for tracks, which decreases the number of identity switches of the same object and, thus, further improves the association accuracy. By using the proposed multi-stage association method, we develop a tracker called MSA-MOT for the 3D multi-object tracking task, alleviating the inherent matching problem in one-stage association. Extensive experiments are conducted on the challenging KITTI benchmark, and the results show that our tracker outperforms the previous state-of-the-art methods in terms of both accuracy and speed. Moreover, the ablation and exploration analysis results demonstrate the effectiveness of the proposed multi-stage association method.

Multi-class Classification and Clustering based Multi-object Tracking

MAT: Motion-Aware Multi-Object Tracking

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Tracklet Siamese Network with Constrained Clustering for Multiple Object Tracking

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

3D Multi-Object Online Tracking with Multi-View Clustering

Real-time Multi-Object Tracking Based on Bi-directional Matching

Multi-object Tracking by Expanding Long-Tracklets

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

Multi-object Tracking Within Air-Traffic-Control Surveillance Videos

Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking

Multi-object tracking algorithm based on interactive attention network and adaptive trajectory reconnection

3D Multi-Object Tracking in Point Clouds Based on Prediction Confidence-Guided Data Association

MSA-MOT: Multi-Stage Association for 3D Multimodality Multi-Object Tracking

Multi-object tracking via deep feature fusion and association analysis

Multi-object tracking via discriminative appearance modeling.

Multi-object tracking with adaptive measurement noise and information fusion

Towards Generalizable Multi-Object Tracking

Learning Feature Extraction and Classification for Tracking Multiple Objects: A Unified Framework

Object Tracking with Multi-View Support Vector Machines.

Joint Counting, Detection and Re-Identification for Multi-Object Tracking