Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

A Level-set Based Tracking Approach for Surveillance Video with Fusion and Occlusion

A Real-Time Approach of Level-Set-Based Contour Tracking for Accurate Foreground Extraction

Video Based Head Detection and Tracking Surveillance System

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Tracking an Object over 200 FPS with the Fusion of Prior Probability and Kalman Filter

Robust Automatic Tracking of Skin-Colored Objects with Level Set based Occlusion Handling

Real Time Object Tracking Using Fused Color And Edge Cues

An Adaptive Shape Subspace Model for Level Set-Based Object Tracking

Multi-object Tracking Via MHT with Multiple Information Fusion in Surveillance Video

Anti-occlusion Particle Filter Object-Tracking Method Based on Feature Fusion

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Multi-strategy object tracking in complex situation for video surveillance

Object Detection and Tracking under Occlusion for Object-Level RGB-D Video Segmentation

Occlusion-aware Visual Tracker using Spatial Structural Information and Dominant Features

Occluded Object Tracking Based On Mean Shift And Accumulation Error Suppression

A novel contour extraction method for motion object detection in surveillance video systems

Tracking Occluded Objects And Recovering Incomplete Trajectories By Reasoning About Containment Relations And Human Actions