Abstract:Multiple-object tracking (MOT) is a crucial component in autonomous driving systems. However, inaccurate object detection is always the bottleneck for MOT. Most detectors are not designed to take the temporal information across consecutive frames into consideration. To take advantage of such information, we design a novel data representation, the spatio-temporal (ST) map, which collects a batch of detection results spatio-temporally, and we train a novel network, ST-TrackNet, to assign predicted track IDs to each positive detection across a sequence. With our ST map detection fed into the tracker, the correlation of objects between adjacent frames becomes prominent, which improves the performance of the tracker in the data association step. Moreover, the long-term trajectory in a sequence also helps to refine the detection results. We train and evaluate our network on the KITTI dataset, a CARLA simulation dataset, and a dataset recorded in a factory environment. Our approach generally achieves superior performance over the state-of-the-art. Note to Practitioners—We investigate the MOT problem in this paper. A spatio-temporal pipeline is proposed to provide a solution to this problem. Object detection results produced by off-the-shelf object detectors are used to form the proposed ST maps. In low signal-to-noise ratio (SNR) situations, our proposed framework can achieve more accurate and robust tracking results with more false-positives. Due to the simplicity and modular design of our framework, it can be applied directly after the detection stage to achieve the online tracking task. The proposed method is evaluated on several datasets, and the experimental results demonstrate its effectiveness. Our method can also be used for other autonomous driving applications, such as path planning and trajectory prediction.

AttentionTrack: Multiple Object Tracking in Traffic Scenarios Using Features Attention

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Prevention of deep vein thrombosis and pulmonary embolism following surgery.

ST-TrackNet: A Multiple-Object Tracking Network Using Spatio-Temporal Information

Online multiple object tracking based on fusing global and partial features

Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking

Multi-object tracking algorithm based on interactive attention network and adaptive trajectory reconnection

MAT: Motion-Aware Multi-Object Tracking

Spatiotemporal adaptive attention 3D multiobject tracking for autonomous driving

Multiple object tracking with appearance feature prediction and similarity fusion

SearchTrack: Multiple Object Tracking with Object-Customized Search and Motion-Aware Features

FAMNet: Joint Learning of Feature, Affinity and Multi-dimensional Assignment for Online Multiple Object Tracking

FACT: Feature Adaptive Continual-learning Tracker for Multiple Object Tracking

Online Multi-Object Tracking Using CNN-based Single Object Tracker with Spatial-Temporal Attention Mechanism

Deep learning and multi-modal fusion for real-time multi-object tracking: Algorithms, challenges, datasets, and comparative study

Multiple Moving Vehicles Tracking Algorithm with Attention Mechanism and Motion Model

Multi-object tracking via deep feature fusion and association analysis

SCGTracker: object feature embedding enhancement based on graph attention networks for multi-object tracking

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking