Abstract:Recently, the tracking-by-detection methods have achieved excellent performance in Multi-Object Tracking (MOT), which focuses on obtaining a robust feature for each object and generating tracklets based on feature similarity. However, they are confronted with two issues: 1) unstable features in short-term occlusion; 2) insufficient matching in long-term occlusion. Specifically, the unstable feature is caused by the appearance variation under occlusion, and the association with the current unstable feature will lead to insufficient matching in long-term occlusion. To address the above issues, we propose a two-stage tracklet-level association method, Spatial-Temporal Tracklet Association (STTA), to effectively combine spatial-temporal context between feature extraction and data association. In the first stage, we propose the Tracklet-guided Spatial-Temporal Attention network (TSTA) to generate robust and stable features. Specifically, TSTA captures spatial-temporal context to obtain the most salient regions between the current and previous clips. In the second stage, we design the Bi-Tracklet Spatial-Temporal association (BTST) module to fully exploit the spatial-temporal context in data association. Specifically, we leverage BTST to merge different tracklets into long-term trajectories by jointly learning visual feature and spatial-temporal context, and designing a bidirectional interpolation to recover the missed objects between matched tracklets. Extensive experiments of public and private detections on four benchmarks demonstrate the robustness of STTA. Furthermore, the proposed method is a model-agnostic method, which can be plugged and played with existing methods to boost their performance, e.g. , obtain 11.0%, 10.1%, 2.9%, 3.2%, 7.8% improvement on IDF1 in MOT16 validation dataset for Tracktor, CenterTrack, Deepsort, JDE, and CTracker, respectively.

Multi-object Tracking by Expanding Long-Tracklets

Multi-object Tracking Through Occlusions by Local Tracklets Filtering and Global Tracklets Association with Detection Responses

Multiple Objects Tracking With Improved Sparse Representation and Rank Based Dynamic Estimation.

Multiple Object Tracking by Reliable Tracklets

Multi-target Tracking by Learning Local-to-global Trajectory Models

Tracklet Association in Detect-then-track Paradigm for Long-term Multi-Person Tracking (Extended Abstract)

Spatio-Temporal clustering model for multi-object tracking through occlusions

Multi-features Guided Robust Visual Tracking.

Long-Term Tracking with Deep Tracklet Association.

Multi-Object Tracking with Spatial-Temporal Tracklet Association

Multi-object tracking based on behaviour and partial observation

Exploiting Hierarchical Dense Structures on Hypergraphs for Multi-Object Tracking

T2Track: Multi-Object Tracking by Associating Between Tracks

Multi-Object Tracking with Inter-Feedback Between Detection and Tracking

Multiple Person Tracking by Spatiotemporal Tracklet Association

Real-time Multi-Object Tracking Based on Bi-directional Matching

Hough Forest-based Association Framework with Occlusion Handling for Multi-Target Tracking

Online Multi-Object Tracking with Three-Stage Data Association

Joint Object Detection and Multi-Object Tracking Based on Hypergraph Matching

Multi-Object Tracking with Partial-Level Features and Adaptive Threshold Mechanism

Online Multi-Object Tracking Using Joint Domain Information in Traffic Scenarios