Abstract:Multi-object tracking tasks aim to assign unique trajectory codes to targets in video frames. Most detection-based tracking methods use Kalman filtering algorithms for trajectory prediction, directly utilizing associated target features for trajectory updates. However, this approach often fails, with camera jitter and transient target loss in real-world scenarios. This paper rethinks state prediction and fusion based on target temporal features to address these issues and proposes the SimpleTrackV2 algorithm, building on the previously designed SimpleTrack. Firstly, to address the poor prediction performance of linear motion models in complex scenes, we designed a target state prediction algorithm called LSTM-MP, based on long short-term memory (LSTM). This algorithm encodes the target's historical motion information using LSTM and decodes it with a multilayer perceptron (MLP) to achieve target state prediction. Secondly, to mitigate the effect of occlusion on target state saliency, we designed a spatiotemporal attention-based target appearance feature fusion (TSA-FF) target state fusion algorithm based on the attention mechanism. TSA-FF calculates adaptive fusion coefficients to enhance target state fusion, thereby improving the accuracy of subsequent data association. To demonstrate the effectiveness of the proposed method, we compared SimpleTrackV2 with the baseline model SimpleTrack on the MOT17 dataset. We also conducted ablation experiments on TSA-FF and LSTM-MP for SimpleTrackV2, exploring the optimal number of fusion frames and the impact of different loss functions on model performance. The experimental results show that SimpleTrackV2 handles camera jitter and target occlusion better, achieving improvements of 1.6%, 3.2%, and 6.1% in MOTA, IDF1, and HOTA, respectively, compared to the SimpleTrack algorithm.

Tracking-Aided Classification of Targets Using Multihypothesis Sequential Probability Ratio Test

Tracking-Aided Target Classification Using Multi-Hypothesis Sequential Test

Randomized Multiple Model Multiple Hypothesis Tracking

Randomized Multimodel Multiple Hypothesis Tracking

Convex Variational Inference for Multi-Hypothesis Fractional Belief Propagation Based Data Association in Multiple Target Tracking Systems

Classification-Aided Robust Multiple Target Tracking Using Neural Enhanced Message Passing

Multitarget Tracking Using Over-the-Horizon Radar.

Multi-sensor Bearings-only Target Tracking Using Two-stage Multiple Hypothesis Tracking.

Multiple Hypothesis Method for Tracking Move‐stop‐move Target

Hypothesis Testing Based Tracking With Spatio-Temporal Joint Interaction Modeling

Multi-Target Tracking with Dependent Likelihood Structures in Labeled Random Finite Set Filters

An efficient algorithm unifying MHT and Multiple Model approaches

SimpleTrackV2: Rethinking the Timing Characteristics for Multi-Object Tracking

Adaptive Tracking of High-Maneuvering Targets Based on Multi-Feature Fusion Trajectory Clustering: LPI's Purpose

A Sequential Two-Stage Track-to-Track Association Method in Asynchronous Bearings-Only Sensor Networks for Aerial Targets Surveillance

Generalized Labeled Multi-Bernoulli Multi-Target Tracking with Doppler-Only Measurements

Three-dimensional Target Motion Analysis Using Angle-Only Measurements

Radar Multiframe Detection in a Complicated Multitarget Environment.

A Multiple Hypothesis Tracking Method for Extended Target Tracking

Multi-Target Joint Detection; Tracking and Classification Based on Marginal GLMB Filter and Belief Function Theory.

Threshold Factor Track Classification Algorithm Based on Target Motion Model