Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Tracking Assisted Faster Video Object Detection

Fast compressive tracking algorithm based on motion vector and assigning weight value

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Tracking an Object over 200 FPS with the Fusion of Prior Probability and Kalman Filter

Tracking Randomly Moving Objects on Edge Box Proposals

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

High-Speed tracking-by-detection without using image information

Detect to Track and Track to Detect

Optical-flow-based framework to boost video object detection performance with object enhancement

High-Speed Tracking with Mutual Assistance of Feature Filters and Detectors

Fast detection of moving object based on improved frame-difference method

Real-Time Online Multi-Object Tracking in Compressed Domain

Tracking Objects as Points

Real-time Detection of the Moving Object in Video Sequences

Faster object tracking pipeline for real time tracking

Trackingrecommendationdetection

An Active Multi-Object Ultrafast Tracking System with CNN-Based Hybrid Object Detection

Real-Time Multiple Object Tracking with Discriminative Features

Scheduling Framework for Accelerating Multiple Detection-Free Object Trackers

Real-Time and Accurate Object Detection in Compressed Video by Long Short-term Feature Aggregation