Abstract:Recently, deep learning has achieved great success in visual tracking. The goal of this paper is to review the state-of-the-art tracking methods based on deep learning. First, we introduce the background of deep visual tracking, including the fundamental concepts of visual tracking and related deep learning algorithms. Second, we categorize the existing deep-learning-based trackers into three classes according to network structure, network function and network training. For each categorize, we explain its analysis of the network perspective and analyze papers in different categories. Then, we conduct extensive experiments to compare the representative methods on the popular OTB-100, TC-128 and VOT2015 benchmarks. Based on our observations, we conclude that: (1) The usage of the convolutional neural network (CNN) model could significantly improve the tracking performance. (2) The trackers using the convolutional neural network (CNN) model to distinguish the tracked object from its surrounding background could get more accurate results, while using the CNN model for template matching is usually faster. (3) The trackers with deep features perform much better than those with low-level hand-crafted features. (4) Deep features from different convolutional layers have different characteristics and the effective combination of them usually results in a more robust tracker. (5) The deep visual trackers using end-to-end networks usually perform better than the trackers merely using feature extraction networks. (6) For visual tracking, the most suitable network training method is to per-train networks with video information and online fine-tune them with subsequent observations. Finally, we summarize our manuscript and highlight our insights, and point out the further trends for deep visual tracking.

Deep Learning and Its Application in Object Recognition and Tracking

Study on Deep Learning and Its Application in Visual Tracking.

Advances on Application of Deep Learning for Video Ob ject Tracking

Deep Learning in Visual Tracking: A Review

Review on Video Object Tracking Based on Deep Learning

Deep learning for multiple object tracking: a survey

Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview

Review of Multi-Object Tracking Based on Deep Learning

Advances in Deep Learning Methods for Visual Tracking: Literature Review and Fundamentals

A Review of Target Tracking Based on Deep Learning

Analysis Based on Recent Deep Learning Approaches Applied in Real-Time Multi-Object Tracking: A Review

Application of Deep Learning in Object Detection.

Recent advances in deep learning for object detection

Review of object tracking algorithms in computer vision based on deep learning

Deep Learning in Object Detection and Recognition

Deep visual tracking: Review and experimental comparison

Deep learning in computer vision: A critical review of emerging techniques and application scenarios

Deep Learning for Object Detection, Classification and Tracking in Industry Applications

Object Detection with Deep Learning: A Review