Abstract:Multi-object tracking tasks aim to assign unique trajectory codes to targets in video frames. Most detection-based tracking methods use Kalman filtering algorithms for trajectory prediction, directly utilizing associated target features for trajectory updates. However, this approach often fails, with camera jitter and transient target loss in real-world scenarios. This paper rethinks state prediction and fusion based on target temporal features to address these issues and proposes the SimpleTrackV2 algorithm, building on the previously designed SimpleTrack. Firstly, to address the poor prediction performance of linear motion models in complex scenes, we designed a target state prediction algorithm called LSTM-MP, based on long short-term memory (LSTM). This algorithm encodes the target's historical motion information using LSTM and decodes it with a multilayer perceptron (MLP) to achieve target state prediction. Secondly, to mitigate the effect of occlusion on target state saliency, we designed a spatiotemporal attention-based target appearance feature fusion (TSA-FF) target state fusion algorithm based on the attention mechanism. TSA-FF calculates adaptive fusion coefficients to enhance target state fusion, thereby improving the accuracy of subsequent data association. To demonstrate the effectiveness of the proposed method, we compared SimpleTrackV2 with the baseline model SimpleTrack on the MOT17 dataset. We also conducted ablation experiments on TSA-FF and LSTM-MP for SimpleTrackV2, exploring the optimal number of fusion frames and the impact of different loss functions on model performance. The experimental results show that SimpleTrackV2 handles camera jitter and target occlusion better, achieving improvements of 1.6%, 3.2%, and 6.1% in MOTA, IDF1, and HOTA, respectively, compared to the SimpleTrack algorithm.

A time-weighted metric for sets of trajectories to assess multi-object tracking algorithms

A Metric for Multi-Target Continuous-Time Trajectory Evaluation.

A Comprehensive Performance Metric for Evaluation of Multi-Target Tracking Algorithms

Tracking Every Thing in the Wild.

TGOSPA Metric Parameters Selection and Evaluation for Visual Multi-object Tracking

Multiple Objects Tracking With Improved Sparse Representation and Rank Based Dynamic Estimation.

Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics

Multi-object trajectory tracking

A Cost Function Approach for Multi-Human Tracking

Individual Adaptive Metric Learning for Visual Tracking

Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation

An Algorithm for Multiple Object Trajectory Tracking.

Optimal Subpattern Assignment Metric for Multiple Tracks (OSPAMT Metric)

MONCE Tracking Metrics: a comprehensive quantitative performance evaluation methodology for object tracking

SimpleTrackV2: Rethinking the Timing Characteristics for Multi-Object Tracking

Distributed Multisensor Multitarget Tracking Algorithm with Time-Offset Registration

An Uncertainty-Aware Performance Measure for Multi-Object Tracking

Tracklet Association in Detect-Then-Track Paradigm for Long-Term Multi-person Tracking

Time-Offset Estimation In Multisensor Tracking Systems

Time Varying Metric Learning for Visual Tracking

HOTA: A Higher Order Metric for Evaluating Multi-object Tracking