Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Hierarchical data association and depth-invariant appearance model for indoor multiple objects tracking

Scene-Adaptive Hierarchical Data Association for Multiple Objects Tracking

Robust Object Tracking with a Hierarchical Ensemble Framework

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Multi-target Tracking with Hierarchical Data Association Using Main-Parts and Spatial-Temporal Feature Models

Hierarchical Data Association Framework with Occlusion Handling for Multiple Targets Tracking

RGB-D Tracker under Hierarchical Structure

Spatio-Temporal clustering model for multi-object tracking through occlusions

Multi-object tracking via discriminative appearance modeling.

Online Hierarchical Sparse Representation of Multifeature for Robust Object Tracking

Research on Multi-target Tracking Algorithm Based on Classified Data Association

Robust Visual Tracking Based on Hierarchical Appearance Model.

Instance Segmentation Enabled Hybrid Data Association and Discriminative Hashing for Online Multi-Object Tracking

Online Association by Continuous-Discrete Appearance Similarity Measurement for Multi-Object Tracking

Exploiting Hierarchical Dense Structures on Hypergraphs for Multi-Object Tracking

A Hierarchical Association Framework for Multi-Object Tracking in Airborne Videos

Object Tracking with Hierarchical Multiview Learning

Part-Based Data Association for Visual Tracking

Multi-Object Tracking by Hierarchical Visual Representations

Learning Deep Appearance Feature for Multi-target Tracking

Object Tracking under Occlusions by Hierarchical Part Matching