Abstract:In this work, we propose a novel visual tracking algorithm based on a framework of generative model. In order to make the algorithm robust to various challenging appearance changes, we adopt the powerful deep features in the description of tracking object appearance. The features are extracted from a Convolutional Neural Network (CNN), which is a modified one based on the VGG-M nets but constructed with fewer convolution layers and sequences exclusively full connection layers. In the pretraining process, we add a special convolution layer called coefficients layer before the full connection layers. In the tracking process after the network being pretrained, we remove the coefficients layer and just update the full connection layers conditionally. To decide the new target’s positions, we compute the compositive similarity scores containing three kinds of similarities with different weights. The first kind is similarities between candidates and the target in the first frame, and the second kind is between candidates and tracking results in the last frame. The third kind is related to the important object appearance variations in the tracking process. We design a simple mechanism to produce a collection to record those historical templates when the object appearance changed largely. With similarities between candidates and the historical templates, the drift problem can be alleviated to some extent, because similar historical appearances sometimes appear repeatedly and the recorded historical templates can provide important information. We use the outputs of the convolution part before the full connection layers as features and weight them with the coefficients layer’s filter weights to compute all similarities. Finally, candidates with the highest scores will be regarded as new targets in the current frame. The evaluated results on CVPR2013 Online Object Tracking Benchmark show that our algorithm can achieve outstanding performance compared with state-of-the-art trackers.

Robust Tracking by Selecting Object-Related Candidates with Deep Features

Multi-features Guided Robust Visual Tracking.

Large Margin Object Tracking with Circulant Feature Maps

Robust Visual Tracking Method via Deep Learning

Robust Visual Tracking with Deep Feature Fusion

Robust Visual Tracking Via Hierarchical Convolutional Features

A Robust Tracking with Low-Dimensional Target-Specific Feature Extraction.

Target-Aware Deep Tracking

Dual Deep Network for Visual Tracking

Hierarchical Convolutional Features for Visual Tracking

Robust Visual Tracking Using Feature-Based Visual Attention

Robust Visual Tracking Via Collaborative and Reinforced Convolutional Feature Learning

Learning Robust Features for Planar Object Tracking

Deep visual tracking: Review and experimental comparison

Visual object tracking based on residual network and cascaded correlation filters

A deep features based generative model for visual tracking

Exploiting Weak Mask Representation with Convolutional Neural Networks for Accurate Object Tracking.

Robust Online Tracking Via Contrastive Spatio-Temporal Aware Network.

Visual tracking via robust multi-task multi-feature joint sparse representation

Robust Visual Tracking Via an Improved Background Aware Correlation Filter.

Robust Visual Tracking Based on Convolutional Neural Networks and Conformal Predictor