Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

TraSw: Tracklet-Switch Adversarial Attacks Against Multi-Object Tracking.

F&F Attack: Adversarial Attack Against Multiple Object Trackers by Inducing False Negatives and False Positives

Blinding and blurring the multi-object tracker with adversarial perturbations

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

BankTweak: Adversarial Attack against Multi-Object Trackers by Manipulating Feature Banks

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

RASTMTrack: Robust and Adaptive Space-Time Memory Networks for Visual Tracking

MAT: Motion-Aware Multi-Object Tracking

Hijacking Tracker: A Powerful Adversarial Attack on Visual Tracking.

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

TPTrack: Strengthening tracking-by-detection methods from tracklet processing perspectives

Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking

Pluggable Attack for Visual Object Tracking

Only Once Attack: Fooling the Tracker with Adversarial Template

Follow-me: Deceiving Trackers with Fabricated Paths

Fooling Detection Alone is Not Enough: First Adversarial Attack against Multiple Object Tracking

Towards Universal Physical Attacks on Single Object Tracking

Multi-object tracking algorithm based on interactive attention network and adaptive trajectory reconnection

SPARK: Spatial-Aware Online Incremental Attack Against Visual Tracking

One-Shot Adversarial Attacks on Visual Tracking With Dual Attention

A trajectory association strategy for multi-object tracking