Abstract:Template-matching methods for visual tracking have gained popularity recently due to their good performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking accuracy still far from state-of-the-art. In this paper, we propose a dynamic memory network to adapt the template to the target's appearance variations during tracking. The reading and writing process of the external memory is controlled by an LSTM network with the search feature map as input. A spatial attention mechanism is applied to concentrate the LSTM input on the potential target as the location of the target is at first unknown. To prevent aggressive model adaptivity, we apply gated residual template learning to control the amount of retrieved memory that is used to combine with the initial template. In order to alleviate the drift problem, we also design a "negative" memory unit that stores templates for distractors, which are used to cancel out wrong responses from the object template. To further boost the tracking performance, an auxiliary classification loss is added after the feature extractor part. Unlike tracking-by-detection methods where the object's information is maintained by the weight parameters of neural networks, which requires expensive online fine-tuning to be adaptable, our tracker runs completely feed-forward and adapts to the target's appearance changes by updating the external memory. Moreover, the capacity of our model is not determined by the network size as with other trackers --- the capacity can be easily enlarged as the memory requirements of a task increase, which is favorable for memorizing long-term object information. Extensive experiments on the OTB and VOT datasets demonstrate that our trackers perform favorably against state-of-the-art tracking methods while retaining real-time speed.

Adaptive Model Based on Voting Probabilistic Models for Image Tracking Algorithm

Pixel Feature-Weighted Scale-Adaptive Object Tracking Algorithm

A Compensatory Algorithm for High-Speed Visual Object Tracking Based on Markov Chain

Adaptive Model Update Strategy for Correlation Filter Trackers.

The improved particle filter for object tracking

Tracking Algorithm of Dual Template Adaptive Updating Based on Multiple Features

Dynamically Modulated Mask Sparse Tracking

Non-Rigid Object Tracking Using Adaptive Part-Based Model

A New Template Update Scheme for Visual Tracking

Novel observation model for probabilistic object tracking

A Template-Drift-Resistant Object Tracking Algorithm

Generalized Kernel-Based Visual Tracking.

Robust Object Tracking Against Template Drift

Effective template update mechanism in visual tracking with background clutter

Robust visual tracking based on generative and discriminative model collaboration

Particle swarm optimization–Markov Chain Monte Carlo for accurate visual tracking with adaptive template update

Model Parameter Adaption-Based Multi-Model Algorithm for Extended Object Tracking Using a Random Matrix.

Object Tracking Algorithm Based on Adaptive Background Information

BackTrack: Robust template update via Backward Tracking of candidate template

Dynamic template updating Siamese network based on status feedback with quality evaluation for visual object tracking

Visual Tracking via Dynamic Memory Networks