Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Moving Object Tracking from Videos Based on Enhanced Space-Time-Range Mean Shift and Motion Consistency

An improved mean shift tracking algorithm based on color and texture feature

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

Motion Objects Segmentation Using a New Level Set Based Method

Recent Advance On Mean Shift Tracking: A Survey

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Video object segmentation by tracking regions

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

Mean-Shift Blob Tracking With Adaptive Feature Selection And Scale Adaptation

Object Tracking using Incremental 2D-PCA Learning and ML Estimation

Video Object Tracking Using Improved Chamfer Matching And Condensation Particle Filter

MAP Spatial Pyramid Mean Shift for Object Tracking

Object Detection and Tracking under Occlusion for Object-Level RGB-D Video Segmentation

Scale adaptable mean shift object tracking based on image fragments

Adaptive Object Tracking in Surveillance System

Adaptive Particle Filters for Visual Object Tracking Using Joint PCA Appearance Model and Consensus Point Correspondences

Real-time Detection of the Moving Object in Video Sequences

A New Tracking Technique: Object Tracking And Identification From Motion