Abstract:Recently, the tracking-by-detection methods have achieved excellent performance in Multi-Object Tracking (MOT), which focuses on obtaining a robust feature for each object and generating tracklets based on feature similarity. However, they are confronted with two issues: 1) unstable features in short-term occlusion; 2) insufficient matching in long-term occlusion. Specifically, the unstable feature is caused by the appearance variation under occlusion, and the association with the current unstable feature will lead to insufficient matching in long-term occlusion. To address the above issues, we propose a two-stage tracklet-level association method, Spatial-Temporal Tracklet Association (STTA), to effectively combine spatial-temporal context between feature extraction and data association. In the first stage, we propose the Tracklet-guided Spatial-Temporal Attention network (TSTA) to generate robust and stable features. Specifically, TSTA captures spatial-temporal context to obtain the most salient regions between the current and previous clips. In the second stage, we design the Bi-Tracklet Spatial-Temporal association (BTST) module to fully exploit the spatial-temporal context in data association. Specifically, we leverage BTST to merge different tracklets into long-term trajectories by jointly learning visual feature and spatial-temporal context, and designing a bidirectional interpolation to recover the missed objects between matched tracklets. Extensive experiments of public and private detections on four benchmarks demonstrate the robustness of STTA. Furthermore, the proposed method is a model-agnostic method, which can be plugged and played with existing methods to boost their performance, e.g. , obtain 11.0%, 10.1%, 2.9%, 3.2%, 7.8% improvement on IDF1 in MOT16 validation dataset for Tracktor, CenterTrack, Deepsort, JDE, and CTracker, respectively.

Tracklet Association in Detect-then-track Paradigm for Long-term Multi-Person Tracking (Extended Abstract)

Tracklet Association in Detect-Then-Track Paradigm for Long-Term Multi-person Tracking

Long-Term Tracking with Deep Tracklet Association.

Multi-object Tracking by Expanding Long-Tracklets

Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation

Spatio-Temporal clustering model for multi-object tracking through occlusions

Multiple Pedestrian Tracking Based on Multi-layer Graph with Tracklet Segmentation and Merging.

Tracklet Association with Online Target-Specific Metric Learning

Re-detection and distractor association from a global perspective: A long-term tracking system

Multi-target tracking using long-term stochastic associations

Multiple Person Tracking by Spatiotemporal Tracklet Association

Multi-target Tracking by Learning Local-to-global Trajectory Models

Exploiting Hierarchical Dense Structures on Hypergraphs for Multi-Object Tracking

Multiple Object Tracking by Reliable Tracklets

Online Multi-Object Tracking Using Joint Domain Information in Traffic Scenarios

Object Tracking Using Bidirectional Spatio-temporal Continuity Tracklet Association

Reinforce Model Tracklet for Multi-Object Tracking.

Multi-appearance segmentation and extended 0-1 programming for dense small object tracking

T2Track: Multi-Object Tracking by Associating Between Tracks

Multi-target Tracking by Non-Linear Motion Patterns Based on Hierarchical Network Flows.

Multi-Object Tracking with Spatial-Temporal Tracklet Association