Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Visual Adaptive Tracking for Monocular Omnidirectional Camera

Equivalent Projection Based Distortion Invariant Visual Tracking for Omnidirectional Vision.

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Multi-features Guided Robust Visual Tracking.

Geometric neighborhood model for visual tracking in central catadioptric omnidirectional vision

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Adaptive visual tracking with failure detection

360VOT: A New Benchmark Dataset for Omnidirectional Visual Object Tracking

360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos

Motion detection for multiple moving targets by using an omnidirectional camera

Adaptive Multifeature Visual Tracking in a Probability-Hypothesis-density Filtering Framework.

Robust Tracking Via Patch-Based Appearance Model and Local Background Estimation

Maneuvering Object Tracking under Large-Area Occlusive Condition Using Mean Shift Embedded IMM Filter

A Visual Tracking Algorithm Via Confidence-Based Multi-Feature Correlation Filtering.

Motion Detection For Multiple Moving Targets By Using An Onmidirectional Camera

MATI: Multimodal Adaptive Tracking Integrator for Robust Visual Object Tracking

Object Tracking Via Deep Multi-View Compressive Model for Visible and Infrared Sequences.

Delving into Motion-Aware Matching for Monocular 3D Object Tracking

Multi-tracker Fusion Via Adaptive Outlier Detection

Visual tracking based on adaptive patches appearance model