Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

A Multi-cue Fused Moving Object Tracker Based on Probabilistic Neural Networks

Head Tracking by Means of Probabilistic Neural Networks

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Tracking Multiple People under Occlusion and Across Cameras Using Probabilistic Models

Robust Head Tracking Based on Multiple Cues Fusion in the Kernel-Bayesian Framework

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Robust Head Tracking with Particles Based on Multiple Cues Fusion

A Novel Video Object Tracking Approach Based on Kernel Density Estimation and Markov Random Field

A Multi-cue Fusion Algorithm for Visual Tracking of Human Motion

MAT: Motion-Aware Multi-Object Tracking

Multi-Modal Face Tracking Using Bayesian Network.

A Dynamic Bayesian Network Approach to Multi-Cue Based Visual Tracking

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

PTMOT: A Probabilistic Multiple Object Tracker Enhanced by Tracklet Confidence for Autonomous Driving

A Multi-Object Tracker Using Dynamic Bayesian Networks and a Residual Neural Network Based Similarity Estimator.

Visual tracking algorithm based on CAMSHIFT and multi-cue fusion for human motion analysis

PANet: An end-to-end Network based on Relative Motion for Online Multi-object Tracking

Probabilistic Multiple Cue Integration for Particle Filter Based Tracking

Moving Target Tracking Based on Pulse Coupled Neural Network and Optical Flow.

The framework of multi-target tracking based on neural network and motion model prediction

Robust Head Tracking Based on a Multi-State Particle Filter