Abstract:Existing multi‐object tracking approaches use rule‐based or deep learning‐based methods, but the former yields suboptimal results for complex object movements, while the latter lacks interpretability and involves complex modules. This work proposes a simplified deep learning‐based model using a lightweight transformer encoder and introduces interpretability through contrastive regularisation losses. Experimental results show improved performance in existing tracking networks with minimal overhead and negligible costs. Achieving high‐performance in multi‐object tracking algorithms heavily relies on modelling spatial‐temporal relationships during the data association stage. Mainstream approaches encompass rule‐based and deep learning‐based methods for spatial‐temporal relationship modelling. While the former relies on physical motion laws, offering wider applicability but yielding suboptimal results for complex object movements, the latter, though achieving high‐performance, lacks interpretability and involves complex module designs. This work aims to simplify deep learning‐based spatial‐temporal relationship models and introduce interpretability into features for data association. Specifically, a lightweight single‐layer transformer encoder is utilised to model spatial‐temporal relationships. To make features more interpretative, two contrastive regularisation losses based on representation alignment are proposed, derived from spatial‐temporal consistency rules. By applying weighted summation to affinity matrices, the aligned features can seamlessly integrate into the data association stage of the original tracking workflow. Experimental results showcase that our model enhances the majority of existing tracking networks' performance without excessive complexity, with minimal increase in training overhead and nearly negligible computational and storage costs.

Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Tracking

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Visual Object Tracking Based on Multi-exemplar Regression Model

Representation Alignment Contrastive Regularization for Multi-Object Tracking

Representation alignment contrastive regularisation for multi‐object tracking

Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking

CLMTR: a Generic Framework for Contrastive Multi-Modal Trajectory Representation Learning

Multi-Target Multi-Camera Tracking with Spatial-Temporal Network

Distractor-aware discrimination learning for online multiple object tracking

Dynamic Attention Guided Multi-Trajectory Analysis for Single Object Tracking

A Multi-Object Tracking Approach Combining Contextual Features and Trajectory Prediction

Object Tracking Via Online Trajectory Optimization With Multi-Feature Fusion

Online Multiple Object Tracking Using a Novel Discriminative Module for Autonomous Driving

Delving into the Trajectory Long-tail Distribution for Muti-object Tracking

Multi-target Tracking by Learning Local-to-global Trajectory Models

Learning Task-Specific Discriminative Representations for Multiple Object Tracking

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

Robust Online Tracking Via Contrastive Spatio-Temporal Aware Network.

Collaborative Strategy for Visual Object Tracking

Multi-Task Structure-Aware Context Modeling for Robust Keypoint-Based Object Tracking

Multiple Object Tracking with Adaptive Multi-Features Fusion and Improved Learnable Graph Matching