Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Artificial Potential Field Based Cooperative Particle Filter for Multi-View Multi-Object Tracking

The improved particle filter for object tracking

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Visual Object Tracking Based on Motion-Adaptive Particle Filter under Complex Dynamics

Multi-object Tracking Through Occlusions by Local Tracklets Filtering and Global Tracklets Association with Detection Responses

Multi-person tracking-by-detection with local particle filtering and global occlusion handling

Object Tracking Via Collaborative Multi-Task Learning and Appearance Model Updating

A Distributed Multi-View Object Tracking Algorithm Under the Bayesian Framework

An Occlusion Tolerent Method For Multi-Object Tracking

Multi-task Correlation Particle Filter for Robust Object Tracking

Visual obj ect tracking based on collaborative model using multiple features

A Bayesian Filter for Multi-view 3D Multi-object Tracking with Occlusion Handling

A Two-Step Approach To Multiple Facial Feature Tracking: Temporal Particle Filter And Spatial Belief Propagation

Multi-object Tracking by Expanding Long-Tracklets

Anti-occlusion Particle Filter Object-Tracking Method Based on Feature Fusion

Tracking A Large Number of Closely Spaced Objects Based on the Particle Probability Hypothesis Density Filter Via Optical Sensor

MapTrack: Tracking in the Map

An End-to-end Tracking Framework Via Multi-View and Temporal Feature Aggregation

Tracking via Robust Multi-task Multi-view Joint Sparse Representation

A Compact Association of Particle Filtering and Kernel Based Object Tracking

Generic Vehicle Tracking Framework Capable of Handling Occlusions Based on Modified Mixture Particle Filter