Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

A Moving Target Detection and Localization Strategy Based on Optical Flow and Pin-hole Imaging Methods Using Monocular Vision

A Systematic Solution for Moving-Target Detection and Tracking While Only Using a Monocular Camera

Moving target tracking using sparse optical flow method

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Optical Flow Based Obstacle Detection in Static Environment

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

A Novel Moving Object Detection Algorithm Based on Robust Image Feature Threshold Segmentation with Improved Optical Flow Estimation

3D Target Detection and Tracking Based on Scene Flow

Moving Target Tracking Based on Pulse Coupled Neural Network and Optical Flow.

An Efficient Optical Flow Based Motion Detection Method for Non-stationary Scenes

An effective motion object detection method using optical flow estimation under a moving camera

Dense Monocular Motion Segmentation Using Optical Flow and Pseudo Depth Map: A Zero-Shot Approach

Enhancing Small Moving Target Detection Performance in Low-Quality and Long-Range Infrared Videos Using Optical Flow Techniques

Motion Targets Tracking Algorithm Based on Video Surveillance

Mobile Target Tracking Based on Hybrid Open-Loop Monocular Vision Motion Control Strategy

Optical Flow Based Real-time Moving Object Detection in Unconstrained Scenes.

Object Tracking in Satellite Videos Based on a Multi-Frame Optical Flow Tracker

Moving vehicle detecting and tracking based on image layered optical flow algorithm

Moving Object Attention Selection Using Optical Flow And Pulse Coupled Neural Network

Motion detection for multiple moving targets by using an omnidirectional camera

Motion Detection For Multiple Moving Targets By Using An Onmidirectional Camera