Abstract:In detection-based multi-object tracking (MOT), one challenging problem is to design a robust affinity model for data association. Moreover, since these approaches entirely rely on detection responses to locate targets, a strategy should be taken to deal with a detector’s defect. In this paper, we propose a robust online MOT tracking method that can handle these two issues effectively. We first present a novel affinity model by jointly learning more powerful feature representation and distance metric within a deep architecture. Specifically, we design a convolutional neural network to extract appearance cue tailored toward person Re-ID and a long short-term memory network to extract motion cue to encode dynamics of targets. Both the cues are then combined with a triplet loss function, which performs end-to-end deep metric learning to encode dependences across both cues automatically and thus generates fused features in embedding space to distinguish targets. To overcome the detector’s limitation, a trajectory estimation strategy is presented. We design a recurrent neural network-based Bayesian filtering module, which takes a hidden state of the above-mentioned LSTM network as an input and performs recursive prediction and update for explicitly estimating targets state. In this way, we can reconstruct trajectories by filling the gaps where no detections are present or adjusting the exact locations of trajectory where detections are imprecise. The experiments on the challenging MOT 2015 and 2016 datasets show very competitive results when comparing our method with the recent state-of-the-art batch and online tracking approaches. We achieve top one in terms of multiple objects tracking accuracy and multiple objects tracking precision among online methods on the MOT2016 dataset.

Convolutional Neural Network-based Simple Online Multiple Object Tracking

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Online Multi-Object Tracking with Convolutional Neural Networks.

Multiple Hypothesis Tracking Based on Discriminative Appearance Features of Convolutional Neural Network

Online Multi-Object Tracking Based on Feature Representation and Bayesian Filtering Within a Deep Learning Architecture

The Application Of Neural Network In Multiple Object Tracking

Semi-Online Multiple Object Tracking Using Graphical Tracklet Association

Online Multiple Person Tracking Using Fully-Convolutional Neural Networks and Motion Invariance Constraints

Multiple Object Tracking Based on Appearance and Motion Graph Convolutional Neural Networks with an Explainer

Online Multi-Object Tracking Exploiting Pose Estimation And Global-Local Appearance Features

Online Multi-Object Tracking Using CNN-based Single Object Tracker with Spatial-Temporal Attention Mechanism

Online multiple object tracking based on fusing global and partial features

Online Multiple Object Tracking Based on State Prediction and Motion Structure

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Long-short Term Prediction for Occluded Multiple Object Tracking.

Online Multiple Object Tracking with Recurrent Neural Networks and Appearance Model

Multimodal Multiobject Tracking by Fusing Deep Appearance Features and Motion Information

Online Multi-Object Tracking Using KCF-based Single-Object Tracker with Occlusion Analysis

Multiple Object Tracking With Attention to Appearance, Structure, Motion and Size

Multi-task Deep Learning for Fast Online Multiple Object Tracking

Online Multiple Object Tracking Via Flow And Convolutional Features