Abstract:Recently, the tracking-by-detection methods have achieved excellent performance in Multi-Object Tracking (MOT), which focuses on obtaining a robust feature for each object and generating tracklets based on feature similarity. However, they are confronted with two issues: 1) unstable features in short-term occlusion; 2) insufficient matching in long-term occlusion. Specifically, the unstable feature is caused by the appearance variation under occlusion, and the association with the current unstable feature will lead to insufficient matching in long-term occlusion. To address the above issues, we propose a two-stage tracklet-level association method, Spatial-Temporal Tracklet Association (STTA), to effectively combine spatial-temporal context between feature extraction and data association. In the first stage, we propose the Tracklet-guided Spatial-Temporal Attention network (TSTA) to generate robust and stable features. Specifically, TSTA captures spatial-temporal context to obtain the most salient regions between the current and previous clips. In the second stage, we design the Bi-Tracklet Spatial-Temporal association (BTST) module to fully exploit the spatial-temporal context in data association. Specifically, we leverage BTST to merge different tracklets into long-term trajectories by jointly learning visual feature and spatial-temporal context, and designing a bidirectional interpolation to recover the missed objects between matched tracklets. Extensive experiments of public and private detections on four benchmarks demonstrate the robustness of STTA. Furthermore, the proposed method is a model-agnostic method, which can be plugged and played with existing methods to boost their performance, e.g. , obtain 11.0%, 10.1%, 2.9%, 3.2%, 7.8% improvement on IDF1 in MOT16 validation dataset for Tracktor, CenterTrack, Deepsort, JDE, and CTracker, respectively.

HSTrack: Bootstrap End-to-End Multi-Camera 3D Multi-object Tracking with Hybrid Supervision

Split and Connect: A Universal Tracklet Booster for Multi-Object Tracking

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

InterTrack: Interaction Transformer for 3D Multi-Object Tracking

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

MAT: Motion-Aware Multi-Object Tracking

Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking

TPTrack: Strengthening tracking-by-detection methods from tracklet processing perspectives

Multi-Object Tracking with Spatial-Temporal Tracklet Association

ADA-Track: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Association

Spatiotemporal adaptive attention 3D multiobject tracking for autonomous driving

Spatial-Attention Location-Aware Multi-Object Tracking

ST-Tracking: Spatial-temporal Graph Convolution Neural Network for Multi-object Tracking

RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework

MCTrack: A Unified 3D Multi-Object Tracking Framework for Autonomous Driving

ST-TrackNet: A Multiple-Object Tracking Network Using Spatio-Temporal Information

Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Tracking

Rt-Track: Robust Tricks for Multi-Pedestrian Tracking

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

ShaSTA: Modeling Shape and Spatio-Temporal Affinities for 3D Multi-Object Tracking

Exploiting Multimodal Spatial-temporal Patterns for Video Object Tracking