Abstract:In detection-based multi-object tracking (MOT), one challenging problem is to design a robust affinity model for data association. Moreover, since these approaches entirely rely on detection responses to locate targets, a strategy should be taken to deal with a detector’s defect. In this paper, we propose a robust online MOT tracking method that can handle these two issues effectively. We first present a novel affinity model by jointly learning more powerful feature representation and distance metric within a deep architecture. Specifically, we design a convolutional neural network to extract appearance cue tailored toward person Re-ID and a long short-term memory network to extract motion cue to encode dynamics of targets. Both the cues are then combined with a triplet loss function, which performs end-to-end deep metric learning to encode dependences across both cues automatically and thus generates fused features in embedding space to distinguish targets. To overcome the detector’s limitation, a trajectory estimation strategy is presented. We design a recurrent neural network-based Bayesian filtering module, which takes a hidden state of the above-mentioned LSTM network as an input and performs recursive prediction and update for explicitly estimating targets state. In this way, we can reconstruct trajectories by filling the gaps where no detections are present or adjusting the exact locations of trajectory where detections are imprecise. The experiments on the challenging MOT 2015 and 2016 datasets show very competitive results when comparing our method with the recent state-of-the-art batch and online tracking approaches. We achieve top one in terms of multiple objects tracking accuracy and multiple objects tracking precision among online methods on the MOT2016 dataset.

Enhancing Resolvable Group Target Tracking: Integration of Labeled Multi-Bernoulli Filter with Deep Learning Approaches

CBMeMBer Filter Based Resolvable Group Target Tracking Via Graph Theory and Leader-Follower Model

Labeled Multi-Bernoulli Filter Based Multiple Resolvable Group Targets Tracking with Leader-Follower Model.

Resolvable Group Target Tracking Via Multi-Bernoulli Filter and Its Application to Sensor Control Scenario

Augmented LRFS-based Filter: Holistic Tracking of Group Objects

Labeled Multi-Bernoulli Filter Based Group Target Tracking Using SDE and Graph Theory

Interactive Multiple-Target Tracking via Labeled Multi-Bernoulli Filters

Distributed Multiple Resolvable Group Targets Tracking Based on Hypergraph Matching

A Robust Student's T-Based Labeled Multi-Bernoulli Filter

Multi-target tracking algorithm based on deep learning

TLPG-Tracker: Joint Learning of Target Localization and Proposal Generation for Visual Tracking.

Learning to Track Multiple Radar Targets with Long Short-Term Memory Networks

A Hypergraph Matching Labeled Multi-Bernoulli Filter for Group Targets Tracking

Online Multi-Target Tracking Using Recurrent Neural Networks

A Poisson Multi-Bernoulli Mixture Filter for Tracking Multiple Resolvable Group Targets

Consensus-Based Labeled Multi-Bernoulli Filter for Multitarget Tracking in Distributed Sensor Network.

Target-Aware Deep Tracking

Learning to Track by Bi-Directional Long Short-Term Memory Networks.

Online Multi-Object Tracking Based on Feature Representation and Bayesian Filtering Within a Deep Learning Architecture

Long Short-Term Memory-Based Deep Recurrent Neural Networks for Target Tracking

Data-driven XGBoost-based Filter for Target Tracking