Abstract:Deep neural networks, albeit their great success on feature learning in various computer vision tasks, are usually considered as impractical for online visual tracking, because they require very long training time and a large number of training samples. In this paper, we present an efficient and very robust tracking algorithm using a single convolutional neural network (CNN) for learning effective feature representations of the target object in a purely online manner. Our contributions are multifold. First, we introduce a novel truncated structural loss function that maintains as many training samples as possible and reduces the risk of tracking error accumulation. Second, we enhance the ordinary stochastic gradient descent approach in CNN training with a robust sample selection mechanism. The sampling mechanism randomly generates positive and negative samples from different temporal distributions, which are generated by taking the temporal relations and label noise into account. Finally, a lazy yet effective updating scheme is designed for CNN training. Equipped with this novel updating algorithm, the CNN model is robust to some long-existing difficulties in visual tracking, such as occlusion or incorrect detections, without loss of the effective adaption for significant appearance changes. In the experiment, our CNN tracker outperforms all compared state-of-the-art methods on two recently proposed benchmarks, which in total involve over 60 video sequences. The remarkable performance improvement over the existing trackers illustrates the superiority of the feature representations, which are learned purely online via the proposed deep learning framework.

Online Video Tracking Using Collaborative Convolutional Networks

Video Object Tracking Via Online Convolutional Network

CFNN: Correlation Filter Neural Network for Visual Object Tracking

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

UCT: Learning Unified Convolutional Networks for Real-time Visual Tracking

High Performance Visual Object Tracking with Unified Convolutional Networks

Robust Visual Tracking via Convolutional Networks

DeepTrack: Learning Discriminative Feature Representations Online for Robust Visual Tracking

A Collaborative Visual Tracking Architecture for Correlation Filter and Convolutional Neural Network Learning

Online Multi-Object Tracking with Convolutional Neural Networks.

Homography Decomposition Networks for Planar Object Tracking

Visual Tracking Jointly with Online and Offline Learning

Real-Time Online Multi-Object Tracking in Compressed Domain

Exploiting Weak Mask Representation with Convolutional Neural Networks for Accurate Object Tracking.

Occlusion-Aware Real-Time Object Tracking

Robust Event-Based Object Tracking Combining Correlation Filter and CNN Representation

An Ensemble of Complementary Models for Deep Tracking

Real-time Video Target Tracking Algorithm Utilizing Convolutional Neural Networks (CNN)

Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks

Online Multi-Object Tracking Using CNN-based Single Object Tracker with Spatial-Temporal Attention Mechanism

Fully Convolutional Online Tracking