Abstract:In this work, we propose a novel visual tracking algorithm based on a framework of generative model. In order to make the algorithm robust to various challenging appearance changes, we adopt the powerful deep features in the description of tracking object appearance. The features are extracted from a Convolutional Neural Network (CNN), which is a modified one based on the VGG-M nets but constructed with fewer convolution layers and sequences exclusively full connection layers. In the pretraining process, we add a special convolution layer called coefficients layer before the full connection layers. In the tracking process after the network being pretrained, we remove the coefficients layer and just update the full connection layers conditionally. To decide the new target’s positions, we compute the compositive similarity scores containing three kinds of similarities with different weights. The first kind is similarities between candidates and the target in the first frame, and the second kind is between candidates and tracking results in the last frame. The third kind is related to the important object appearance variations in the tracking process. We design a simple mechanism to produce a collection to record those historical templates when the object appearance changed largely. With similarities between candidates and the historical templates, the drift problem can be alleviated to some extent, because similar historical appearances sometimes appear repeatedly and the recorded historical templates can provide important information. We use the outputs of the convolution part before the full connection layers as features and weight them with the coefficients layer’s filter weights to compute all similarities. Finally, candidates with the highest scores will be regarded as new targets in the current frame. The evaluated results on CVPR2013 Online Object Tracking Benchmark show that our algorithm can achieve outstanding performance compared with state-of-the-art trackers.

Generating Reliable Online Adaptive Templates for Visual Tracking

TGAN: A Simple Model Update Strategy for Visual Tracking Via Template-Guidance Attention Network.

Object-Adaptive LSTM Network for Real-time Visual Tracking with Adversarial Data Augmentation

Channel Attention Based Generative Network for Robust Visual Tracking

Dynamic template updating Siamese network based on status feedback with quality evaluation for visual object tracking

Meta-Tracker: Fast and Robust Online Adaptation for Visual Object Trackers

Visual Tracking via Dynamic Memory Networks

Siamese Graph Attention Networks for Robust Visual Object Tracking.

GradNet: Gradient-Guided Network for Visual Object Tracking

A deep features based generative model for visual tracking

Visual Object Tracking with Adaptive Template Update and Global Search Augmentation

Confidence Based Hierarchical Online Ensemble Visual Tracking

Online Visual Tracking Based on Selective Sparse Appearance Model and Spatiotemporal Analysis

Effective Visual Domain Adaptation via Generative Adversarial Distribution Matching

AFAT: Adaptive Failure-Aware Tracker for Robust Visual Object Tracking

Efficient Adversarial Attacks for Visual Object Tracking

Global-local feature-mixed network with template update for visual tracking

Visual Tracking Jointly with Online and Offline Learning

Adaptive Object Tracking with Complementary Models

Effective template update mechanism in visual tracking with background clutter

Adversarial Transfer Networks for Visual Tracking