Abstract:In detection-based multi-object tracking (MOT), one challenging problem is to design a robust affinity model for data association. Moreover, since these approaches entirely rely on detection responses to locate targets, a strategy should be taken to deal with a detector’s defect. In this paper, we propose a robust online MOT tracking method that can handle these two issues effectively. We first present a novel affinity model by jointly learning more powerful feature representation and distance metric within a deep architecture. Specifically, we design a convolutional neural network to extract appearance cue tailored toward person Re-ID and a long short-term memory network to extract motion cue to encode dynamics of targets. Both the cues are then combined with a triplet loss function, which performs end-to-end deep metric learning to encode dependences across both cues automatically and thus generates fused features in embedding space to distinguish targets. To overcome the detector’s limitation, a trajectory estimation strategy is presented. We design a recurrent neural network-based Bayesian filtering module, which takes a hidden state of the above-mentioned LSTM network as an input and performs recursive prediction and update for explicitly estimating targets state. In this way, we can reconstruct trajectories by filling the gaps where no detections are present or adjusting the exact locations of trajectory where detections are imprecise. The experiments on the challenging MOT 2015 and 2016 datasets show very competitive results when comparing our method with the recent state-of-the-art batch and online tracking approaches. We achieve top one in terms of multiple objects tracking accuracy and multiple objects tracking precision among online methods on the MOT2016 dataset.

Online Multiple Object Tracking with Enhanced Re‐identification

Real-Time Online Multi-Object Tracking

Rethinking the Competition Between Detection and ReID in Multiobject Tracking

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Online multi-object tracking with unsupervised re-identification learning and occlusion estimation

Online multi-object tracking with pedestrian re-identification and occlusion processing

Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking

Online Multi-Object Tracking Based on Feature Representation and Bayesian Filtering Within a Deep Learning Architecture

Multi-object Tracking with a Hierarchical Single-branch Network

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Fusion detection and ReID embedding with hybrid attention for multi-object tracking

Feature Disentanglement Network: Multi-Object Tracking Needs More Differentiated Features

HSMR: A Head-Shoulder Mask Aided ResNet to Guide Focus of Re-Identification Implemented on Tour-Guide Robot.

When to Extract ReID Features: A Selective Approach for Improved Multiple Object Tracking

FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking

Efficient Combination Graph Model Based on Conditional Random Field for Online Multi-Object Tracking

Online Multiple Object Tracking with Cross-Task Synergy

Focus On Details: Online Multi-Object Tracking with Diverse Fine-Grained Representation

Real-Time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification

PSMOT: Online Occlusion-Aware Multi-Object Tracking Exploiting Position Sensitivity