Abstract:In detection-based multi-object tracking (MOT), one challenging problem is to design a robust affinity model for data association. Moreover, since these approaches entirely rely on detection responses to locate targets, a strategy should be taken to deal with a detector’s defect. In this paper, we propose a robust online MOT tracking method that can handle these two issues effectively. We first present a novel affinity model by jointly learning more powerful feature representation and distance metric within a deep architecture. Specifically, we design a convolutional neural network to extract appearance cue tailored toward person Re-ID and a long short-term memory network to extract motion cue to encode dynamics of targets. Both the cues are then combined with a triplet loss function, which performs end-to-end deep metric learning to encode dependences across both cues automatically and thus generates fused features in embedding space to distinguish targets. To overcome the detector’s limitation, a trajectory estimation strategy is presented. We design a recurrent neural network-based Bayesian filtering module, which takes a hidden state of the above-mentioned LSTM network as an input and performs recursive prediction and update for explicitly estimating targets state. In this way, we can reconstruct trajectories by filling the gaps where no detections are present or adjusting the exact locations of trajectory where detections are imprecise. The experiments on the challenging MOT 2015 and 2016 datasets show very competitive results when comparing our method with the recent state-of-the-art batch and online tracking approaches. We achieve top one in terms of multiple objects tracking accuracy and multiple objects tracking precision among online methods on the MOT2016 dataset.

Learning Sequence-to-sequence Affinity Metric for Near-Online Multi-Object Tracking

Tracklet Association in Detect-Then-Track Paradigm for Long-Term Multi-person Tracking

Multi-object tracking via discriminative appearance modeling.

Multiple Objects Tracking With Improved Sparse Representation and Rank Based Dynamic Estimation.

Instance Segmentation Enabled Hybrid Data Association and Discriminative Hashing for Online Multi-Object Tracking

Non-local Attention Association Scheme for Online Multi-Object Tracking

Associative affinity network learning for multi-object tracking

Near-Online Multi-target Tracking with Aggregated Local Flow Descriptor

Tracklet Association with Online Target-Specific Metric Learning

Online Multi-Object Tracking Based on Feature Representation and Bayesian Filtering Within a Deep Learning Architecture

A Unified Object Motion And Affinity Model For Online Multi-Object Tracking

A Hybrid Data Association Framework for Robust Online Multi-Object Tracking

Online Multi-Person Tracking Based on Metric Learning.

AETrack: an Efficient Approach for Online Multi-Object Tracking

Multi-Object Tracking Using Online Metric Learning with Long Short-Term Memory.

Sequence-tracker: Multiple object tracking with sequence features in severe occlusion scene

Online Multi-Object Tracking with Three-Stage Data Association

Multi-object tracking via deep feature fusion and association analysis

Online Multi-Object Tracking with Dual Matching Attention Networks

Multi-Pedestrian Tracking Based on Improved Two Step Data Association

Adaptive Affinity for Associations in Multi-Target Multi-Camera Tracking.