Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Improving the Accuracy of Single-Pixel Tracking a Small-Sized Moving Object Using Defocus Blur

Pixel Feature-Weighted Scale-Adaptive Object Tracking Algorithm

A Zoom Tracking Algorithm Based on Defocus Difference

Complementary Moment Detection for Tracking a Fast-Moving Object Using Dual Single-Pixel Detectors

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Adaptive Resolution Optimization and Tracklet Reliability Assessment for Efficient Multi-Object Tracking

Single-pixel imaging of a translational object

Three-Dimensional Tracking at Micro-scale Using a Single Optical Microscope

Single-pixel Imaging of a Translational Object.

Using Digital Image Correlation Method for Realizing the High-Speed Camera Image Sequence Fast Tracking of Moving Targets

Optical Tracking and Size Estimation of a Moving Object Via Time-Division Multiplexing Ghost Imaging

Image-free real-time 3-D tracking of a fast-moving object using dual-pixel detection

Fast Tracking of Moving Objects Using Single-Pixel Imaging

An Image-Tracking Algorithm Based on Object Center Distance-Weighting and Image Feature Recognition

Dual-pixel Tracking of the Fast-Moving Target Based on Window Complementary Modulation.

An Improved Meanshift Tracking Algorithm Using Adaptive Quantization Step in Color Space

Spatio-Temporal Bi-directional Cross-frame Memory for Distractor Filtering Point Cloud Single Object Tracking

Multiple Frequency–spatial Network for RGBT Tracking in the Presence of Motion Blur

Image Motion-Blur-Based Object'S Speed Measurement Using an Interlaced Scan Image

Long-term Tracking with Fast Scale Estimation and Efficient Re-Detection