Abstract:In recent years, deep learning based visual tracking methods have obtained great success owing to the powerful feature representation ability of Convolutional Neural Networks (CNNs). Among these methods, classification-based tracking methods exhibit excellent performance while their speeds are heavily limited by the expensive computation for massive proposal feature extraction. In contrast, matching-based tracking methods (such as Siamese networks) possess remarkable speed superiority. However, the absence of online updating renders these methods unadaptable to significant object appearance variations. In this paper, we propose a novel real-time visual tracking method, which adopts an object-adaptive LSTM network to effectively capture the video sequential dependencies and adaptively learn the object appearance variations. For high computational efficiency, we also present a fast proposal selection strategy, which utilizes the matching-based tracking method to pre-estimate dense proposals and selects high-quality ones to feed to the LSTM network for classification. This strategy efficiently filters out some irrelevant proposals and avoids the redundant computation for feature extraction, which enables our method to operate faster than conventional classification-based tracking methods. In addition, to handle the problems of sample inadequacy and class imbalance during online tracking, we adopt a data augmentation technique based on the Generative Adversarial Network (GAN) to facilitate the training of the LSTM network. Extensive experiments on four visual tracking benchmarks demonstrate the state-of-the-art performance of our method in terms of both tracking accuracy and speed, which exhibits great potentials of recurrent structures for visual tracking.

Object Detection and Tracking based on Recurrent Neural Networks

Robust Object Tracking with a Hierarchical Ensemble Framework

RASTMTrack: Robust and Adaptive Space-Time Memory Networks for Visual Tracking

Online Multi-Target Tracking Using Recurrent Neural Networks

High Speed Recurrent Regression Network for Visual Tracking.

Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks

Online Multiple Object Tracking with Recurrent Neural Networks and Appearance Model

Recurrent Autoregressive Networks for Online Multi-Object Tracking

Learning Hierarchical Features for Visual Object Tracking with Recursive Neural Networks

Object-Adaptive LSTM Network for Real-time Visual Tracking with Adversarial Data Augmentation

Visual Object Tracking Based on Modified LeNet-5 and RCCF

Visual object tracking based on residual network and cascaded correlation filters

Prediction-Decision Network For Video Object Tracking

Deep Tracking: Seeing Beyond Seeing Using Recurrent Neural Networks

Robust Tracking Using Region Proposal Networks.

Detection based visual tracking with convolutional neural network.

Robust Visual Tracking Method via Deep Learning

Learning Multiple Instance Deep Quality Representation for Robust Object Tracking.

Recurrent Filter Learning for Visual Tracking

Real-time Visual Object Tracking with Natural Language Description

Learning a Reliable Decision Making Policy for Robust Tracking