Abstract:In detection-based multi-object tracking (MOT), one challenging problem is to design a robust affinity model for data association. Moreover, since these approaches entirely rely on detection responses to locate targets, a strategy should be taken to deal with a detector’s defect. In this paper, we propose a robust online MOT tracking method that can handle these two issues effectively. We first present a novel affinity model by jointly learning more powerful feature representation and distance metric within a deep architecture. Specifically, we design a convolutional neural network to extract appearance cue tailored toward person Re-ID and a long short-term memory network to extract motion cue to encode dynamics of targets. Both the cues are then combined with a triplet loss function, which performs end-to-end deep metric learning to encode dependences across both cues automatically and thus generates fused features in embedding space to distinguish targets. To overcome the detector’s limitation, a trajectory estimation strategy is presented. We design a recurrent neural network-based Bayesian filtering module, which takes a hidden state of the above-mentioned LSTM network as an input and performs recursive prediction and update for explicitly estimating targets state. In this way, we can reconstruct trajectories by filling the gaps where no detections are present or adjusting the exact locations of trajectory where detections are imprecise. The experiments on the challenging MOT 2015 and 2016 datasets show very competitive results when comparing our method with the recent state-of-the-art batch and online tracking approaches. We achieve top one in terms of multiple objects tracking accuracy and multiple objects tracking precision among online methods on the MOT2016 dataset.

An online learned hough forest model based on improved multi-feature fusion matching for multi-object tracking

Object Tracking Model Based on Fusing Multiple Weighted Distribution Field Features

Multi-target tracking algorithm based on the multi-feature fusion matching and Hough forest

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Hough Forest-based Association Framework with Occlusion Handling for Multi-Target Tracking

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Multi-object tracking via deep feature fusion and association analysis

Multi-features Guided Robust Visual Tracking.

Learning Fully Convolutional Network for Visual Tracking with Multi-Layer Feature Fusion

Online multiple object tracking based on fusing global and partial features

Instance Segmentation Enabled Hybrid Data Association and Discriminative Hashing for Online Multi-Object Tracking

A Visual Tracking Algorithm Via Confidence-Based Multi-Feature Correlation Filtering.

Multiple object tracking with appearance feature prediction and similarity fusion

Multi-object Tracking Via MHT with Multiple Information Fusion in Surveillance Video

Human Tracking Algorithm Based on Model Fusion

Online Multi-Object Tracking Based on Feature Representation and Bayesian Filtering Within a Deep Learning Architecture

Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking

Heterogeneous Association Graph Fusion for Target Association in Multiple Object Tracking

An efficient real-time target tracking algorithm using adaptive feature fusion

Adaptive feature fusion for visual object tracking

Learning a Dynamic Feature Fusion Tracker for Object Tracking