Abstract:Recently, deep learning has achieved great success in visual tracking. The goal of this paper is to review the state-of-the-art tracking methods based on deep learning. First, we introduce the background of deep visual tracking, including the fundamental concepts of visual tracking and related deep learning algorithms. Second, we categorize the existing deep-learning-based trackers into three classes according to network structure, network function and network training. For each categorize, we explain its analysis of the network perspective and analyze papers in different categories. Then, we conduct extensive experiments to compare the representative methods on the popular OTB-100, TC-128 and VOT2015 benchmarks. Based on our observations, we conclude that: (1) The usage of the convolutional neural network (CNN) model could significantly improve the tracking performance. (2) The trackers using the convolutional neural network (CNN) model to distinguish the tracked object from its surrounding background could get more accurate results, while using the CNN model for template matching is usually faster. (3) The trackers with deep features perform much better than those with low-level hand-crafted features. (4) Deep features from different convolutional layers have different characteristics and the effective combination of them usually results in a more robust tracker. (5) The deep visual trackers using end-to-end networks usually perform better than the trackers merely using feature extraction networks. (6) For visual tracking, the most suitable network training method is to per-train networks with video information and online fine-tune them with subsequent observations. Finally, we summarize our manuscript and highlight our insights, and point out the further trends for deep visual tracking.

Survey of Visual Tracking Algorithms

A Survey of Visual Tracking

A Review of Visual Tracking Algorithms

Survey of Video Object Tracking

Moving Object Tracking Research Based on Active Vision

Visual object tracking: A survey

Survey of Object Segmentation Algorithms in Vision-Based Monitoring System

Survey of Single-Target Visual Tracking Methods Based on Online Learning.

A Compensatory Algorithm for High-Speed Visual Object Tracking Based on Markov Chain

A Survey of Multi-object Video Tracking Algorithms

A review of visual moving target tracking

Single Object Tracking Research: A Survey

Visual Tracking via Sparse and Local Linear Coding

Motion Targets Tracking Algorithm Based on Video Surveillance

Multi-features Guided Robust Visual Tracking.

A Survey of Appearance Models in Visual Object Tracking

Multi-modal visual tracking: Review and experimental comparison

Deep visual tracking: Review and experimental comparison

Advances in Deep Learning Methods for Visual Tracking: Literature Review and Fundamentals

Visual Tracking Via Subspace Motion Model

Deep Learning Based Visual Tracking: A Review