Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Robust Tracking of Nonrigid Objects Using Techniques of Inverse Component Uncertainty Factorization Subspace Constraints Optical Flow

Robust Instance Tracking via Uncertainty Flow

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Robust visual tracking via weighted incremental subspace learning

Optic Flow-Multiple Instantaneous Rigid Motions

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Moving target tracking using sparse optical flow method

Robust Outlier Rejection From Optical Flow Tracking Points

Quaternion Based Optical Flow Estimation for Robust Object Tracking

A Robust Optical Flow Tracking Method Based On Prediction Model for Visual-Inertial Odometry.

Computer-Vision-Based Vibration Tracking Using a Digital Camera: A Sparse-Optical-Flow-Based Target Tracking Method

Robust Estimation of Similarity Transformation for Visual Object Tracking

Visual tracking and learning using speeded up robust features

A Robust Optical Flow Computation

Robust Non-Local TV- $L^{1}$ Optical Flow Estimation with Occlusion Detection

Robust Visual Tracking Using the Time-Reversibility Constraint

Uncertainty Estimation of Dense Optical Flow for Robust Visual Navigation

A Robust Optical Flow Estimation under Varying Illumination.

Robust visual tracking in image sequences

Uncertainty Estimation of Dense Optical-Flow for Robust Visual Navigation