Abstract:Multi-object tracking (MOT) is one of the most important tasks of the vision perception module of autonomous driving, which provides crucial inputs for the downstream task modules such as motion prediction, planning and control. However, how to balance the efficiency and accuracy of MOT in autonomous driving scenario, has always been a great challenge. To address this issue, we try to improve the classical DeepSORT model which follows the Track-By-Detection paradigm from three perspectives of object detection, feature extraction and data association, so as to further improve its tracking accuracy while retaining its online, light-weight and high-efficiency advantages. First, a single-stage detection model Yolo-v5 is adopted to replace the two-stage model Faster R-CNN used in DeepSORT, which leads to significant improvement of detection efficiency and accuracy. Second, specified light-weight ShuffleNet-v2 in stead of time-consuming DenseNet is used to extract appearance feature from detected object bounding boxes to further enhance the efficiency of MOT. Finally, an efficient and accurate data association algorithm integrating cascade matching and IoU matching is proposed. Based on the cost matrix jointly constructed by appearance features, motion and shape, effective tracking of multiple objects is realized. A large number of experiments have been conducted to compare our improved MOT model proposed and the DeepSORT model in terms of many evaluation metrics, such as IDs, IDF1, MOTA, MOTP, etc. Moreover, the sensitivity of some hyper-parameters that have important influence on MOT efficiency is also analyzed. Experimental results show that the efficiency and accuracy of MOT can be effectively balanced by keeping the lightweight and efficient characteristics of the original DeepSORT model and further improving the performance of its three key components, i.e. object detection, feature extraction and data association.

MF-SORT: Simple Online and Realtime Tracking with Motion Features.

An Improved Multi-object Tracking Algorithm for Autonomous Driving Based on DeepSORT.

MC-SORT: A Motion Correction-Based Framework for Long-Term Multiple Object Tracking

Multi-object tracking with adaptive measurement noise and information fusion

Hybrid-SORT: Weak Cues Matter for Online Multi-Object Tracking

StrongSORT: Make DeepSORT Great Again

Multiple Object Tracking Based on YOLOv5 and Optimized DeepSORT Algorithm

MAT: Motion-Aware Multi-Object Tracking

StrongOC-SORT: Make Observation-Centric SORT More Robust.

SORT-YM: an Algorithm of Multi-Object Tracking with YOLOv4-Tiny and Motion Prediction

SFSORT: Scene Features-based Simple Online Real-Time Tracker

Achieving Adaptive Visual Multi-Object Tracking with Unscented Kalman Filter

Multiple Objects Tracking With Improved Sparse Representation and Rank Based Dynamic Estimation.

Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identification

A Motion Status Discrimination Method Based on Velocity Estimation Embedded in Multi-object Tracking

FeatureSORT: Essential Features for Effective Tracking

Feature Extraction ( c ) Adjacency Estimation ( d ) Optimization ( a ) Detection 3

Application of SORT on Multi-Object Tracking and Segmentation

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

MapTrack: Tracking in the Map

SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes