Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Robust Monocular Edge Visual Odometry through Coarse-to-Fine Data Association

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

EdgeVO: An Efficient and Accurate Edge-based Visual Odometry

Robust Monocular SLAM in Dynamic Environments

Edge-Direct Visual Odometry

Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors.

A Robust and Integrated Visual Odometry Framework Exploiting the Optical Flow and Feature Point Method

A Dense Optical Flow-Based Feature Matching Approach in Visual Odometry

Robust and Efficient Estimation of Absolute Camera Pose for Monocular Visual Odometry.

Match and Locate: low-frequency monocular odometry based on deep feature matching

Robust Stereo Visual Odometry Based on Probabilistic Decoupling Ego-Motion Estimation and 3D SSC

Bi-direction Direct RGB-D Visual Odometry

A Monocular Visual Odometry Combining Edge Enhance with Deep Learning

A Robust Saliency Integrated Method for Monocular Motion Estimation.

Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines

Self-Supervised monocular visual odometry based on cross-correlation

Edge SLAM: Edge Points Based Monocular Visual SLAM

Robust stereo visual odometry through a probabilistic combination of points and line segments

PL-EVIO: Robust Monocular Event-based Visual Inertial Odometry with Point and Line Features

Tightly Coupled Visual-Inertial Fusion with Image Enhancement for Robust Positioning