Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Online Min Cost Circulation for Multi-Object Tracking on Fragments

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

An Approach for Multi-Object Tracking with Two-Stage Min-Cost Flow

Greedy Batch-Based Minimum-Cost Flows for Tracking Multiple Objects

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

A Hybrid Data Association Framework for Robust Online Multi-Object Tracking

Multiple Object Tracking by Incorporating a Particle Filter into the Min-Cost Flow Model

Multiple Object Tracking by Multi-Feature Combination Based on Min-Cost Network Flow

Adaptive Resolution Optimization and Tracklet Reliability Assessment for Efficient Multi-Object Tracking

Online multi-object tracking with efficient track drift and fragmentation handling

Global Data Association for Multi-Object Tracking Using Network Flows.

Learning of Global Objective for Network Flow in Multi-Object Tracking

Distributed Multi-Object Tracking Under Limited Field of View Heterogeneous Sensors with Density Clustering

Semi-Online Multiple Object Tracking Using Graphical Tracklet Association

A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple Objects

Spatial-Temporal Multi-Cuts for Online Multiple-Camera Vehicle Tracking

AETrack: an Efficient Approach for Online Multi-Object Tracking

One Global Optimization Method in Network Flow Model for Multiple Object Tracking

Enhancing Network Flow for Multi-target Tracking with Detection Group Analysis.

MapTrack: Tracking in the Map