Abstract:Deep networks have been successfully applied to visual tracking by learning a generic representation offline from numerous training images. However the offline training is time-consuming and the learned generic representation may be less discriminative for tracking specific objects. In this paper we present that, even without offline training with a large amount of auxiliary data, simple two-layer convolutional networks can be powerful enough to develop a robust representation for visual tracking. In the first frame, we employ the k-means algorithm to extract a set of normalized patches from the target region as fixed filters, which integrate a series of adaptive contextual filters surrounding the target to define a set of feature maps in the subsequent frames. These maps measure similarities between each filter and the useful local intensity patterns across the target, thereby encoding its local structural information. Furthermore, all the maps form together a global representation, which is built on mid-level features, thereby remaining close to image-level information, and hence the inner geometric layout of the target is also well preserved. A simple soft shrinkage method with an adaptive threshold is employed to de-noise the global representation, resulting in a robust sparse representation. The representation is updated via a simple and effective online strategy, allowing it to robustly adapt to target appearance variations. Our convolution networks have surprisingly lightweight structure, yet perform favorably against several state-of-the-art methods on the CVPR2013 tracking benchmark dataset with 50 challenging videos.

Human tracking using convolutional neural networks.

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

Online Video Tracking Using Collaborative Convolutional Networks

UCT: Learning Unified Convolutional Networks for Real-time Visual Tracking

A cascaded CNN model for multiple human tracking and re-localization in complex video sequences with large displacement

Real-time Video Target Tracking Algorithm Utilizing Convolutional Neural Networks (CNN)

CFNN: Correlation Filter Neural Network for Visual Object Tracking

Detect to Track and Track to Detect

Homography Decomposition Networks for Planar Object Tracking

Robust Visual Tracking via Convolutional Networks

Exploiting Weak Mask Representation with Convolutional Neural Networks for Accurate Object Tracking.

Convolutional Neural Network for Monocular Vision-based Multi-target Tracking

Ensemble Tracking Based on CNN

Tracking of small infrared targets based on convolutional neural network

High Performance Visual Object Tracking with Unified Convolutional Networks

Hierarchical Convolutional Features for Visual Tracking

Object Tracking Via ImageNet Classification Scores

TGCN: Time Domain Graph Convolutional Network for Multiple Objects Tracking

Convolutional neural networks automate detection for tracking of submicron scale particles in 2D and 3D

CVTrack: Combined Convolutional Neural Network and Vision Transformer Fusion Model for Visual Tracking

Video Object Tracking Via Online Convolutional Network