Abstract:Multiple Object Tracking is an important vitally important fundamental task in computer vision. Visual tracking becomes challenging when objects move in groups and are obscured from each other. There are two mainstream solution strategies for these group models. One is to transform the data association problem into a graph matching problem for solving, while the other is to apply the social power model as an advanced constraint for group tracking. In the former case, the solving difficulty geometric growth as the number of tracked objects increases, and the computing efficiency for real-time tracking demand cannot be met. The latter strategy tends to set up fixed-size groups or offline training rules, resulting in a lack of flexibility that limits their scenario generalization. According to the shortcomings of existing methods, this paper proposes a novel multiple object tracking method with spatio-temporal correlation and graph neural networks. Firstly, the relational features of the historical trajectories are extracted through the spatio-temporal relationship learning module, which models the spatio-temporal correlations of the objects and dynamically constructs the group structure online. Then, the graph neural network is combined with appearance and motion information, and the similarity between each detection and tracklet is used as a weight in node feature aggregation to make powerful distinctions between node features. Meanwhile, the spatio-temporal correlation method is also used to solve target loss issues caused by occlusion. Even collocated with linearly assigned data association method, good tracking results are still achieved, with a low computational complexity. Experiments on three challenging public datasets, namely MOT16, MOT17, and MOT20, validated the accuracy and efficiency of the proposed tracking method.

Group tracking: exploring mutual relations for multiple object tracking

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Supplementary Material: Quasi-Dense Similarity Learning for Multiple Object Tracking

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Modeling of Multiple Spatial-Temporal Relations for Robust Visual Object Tracking

InterTrack: Interaction Transformer for 3D Multi-Object Tracking

3D Multi-Object Online Tracking with Multi-View Clustering

Multi-object Tracking by Expanding Long-Tracklets

Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking

Rlm-tracking: online multi-pedestrian tracking supported by relative location mapping

Relation3DMOT: Exploiting Deep Affinity for 3D Multi-Object Tracking from View Aggregation

Multiple Human Association and Tracking from Egocentric and Complementary Top Views

A Graphical Social Topology Model for Multi-Object Tracking.

Towards Generalizable Multi-Object Tracking

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

Real-time Multi-Object Tracking Based on Bi-directional Matching

Multi-object Tracking Via MHT with Multiple Information Fusion in Surveillance Video

MMF-Track: Multi-modal Multi-level Fusion for 3D Single Object Tracking

SCGTracker: Spatio-temporal correlation and graph neural networks for multiple object tracking