Abstract:In this work, we propose a novel visual tracking algorithm based on a framework of generative model. In order to make the algorithm robust to various challenging appearance changes, we adopt the powerful deep features in the description of tracking object appearance. The features are extracted from a Convolutional Neural Network (CNN), which is a modified one based on the VGG-M nets but constructed with fewer convolution layers and sequences exclusively full connection layers. In the pretraining process, we add a special convolution layer called coefficients layer before the full connection layers. In the tracking process after the network being pretrained, we remove the coefficients layer and just update the full connection layers conditionally. To decide the new target’s positions, we compute the compositive similarity scores containing three kinds of similarities with different weights. The first kind is similarities between candidates and the target in the first frame, and the second kind is between candidates and tracking results in the last frame. The third kind is related to the important object appearance variations in the tracking process. We design a simple mechanism to produce a collection to record those historical templates when the object appearance changed largely. With similarities between candidates and the historical templates, the drift problem can be alleviated to some extent, because similar historical appearances sometimes appear repeatedly and the recorded historical templates can provide important information. We use the outputs of the convolution part before the full connection layers as features and weight them with the coefficients layer’s filter weights to compute all similarities. Finally, candidates with the highest scores will be regarded as new targets in the current frame. The evaluated results on CVPR2013 Online Object Tracking Benchmark show that our algorithm can achieve outstanding performance compared with state-of-the-art trackers.

Robust visual tracking based on generative and discriminative model collaboration

Locality-Constrained Collaborative Model for Robust Visual Tracking.

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Robust visual tracking based on incremental discriminative projective non-negative matrix factorization

Combined Discriminative Global and Generative Local Models for Visual Tracking

Robust Object Tracking Via Sparse Collaborative Appearance Model.

Object Tracking Via Collaborative Multi-Task Learning and Appearance Model Updating

A deep features based generative model for visual tracking

Multi-scale Patch-Based Sparse Appearance Model for Robust Object Tracking

Robust Visual Tracking Based on OLDM and Bayesian Estimation

Robust Object Tracking Via Sparsity-Based Collaborative Model

Robust Visual Tracking Via Collaborative Motion and Appearance Model

Visual tracking via shallow and deep collaborative model

Robust Visual Tracking Based on Hierarchical Appearance Model.

A new real-time robust object tracking method

Robust Visual Tracking Via Identifying Multi-Scale Patches

Object Tracking Based on Locality-Constrained Linear Coding Joint Sparse Representation Appearance Model

Robust visual tracking combining global and local appearance models.

Robust Object Tracking Via Weight-Based Local Sparse Appearance Model

ROBUST OBJECT TRACKING VIA MULTI-TASK BASED COLLABORATIVE MODEL

Robust Tracking Via Patch-Based Appearance Model and Local Background Estimation