Abstract:Convolutional neural networks (CNNs) have been successfully applied to the single target tracking task in recent years. Generally, training a deep CNN model requires numerous labeled training samples, and the number and quality of these samples directly affect the representational capability of the trained model. However, this approach is restrictive in practice, because manually labeling such a large number of training samples is time-consuming and prohibitively expensive. In this article, we propose an active learning method for deep visual tracking, which selects and annotates the unlabeled samples to train the deep CNN model. Under the guidance of active learning, the tracker based on the trained deep CNN model can achieve competitive tracking performance while reducing the labeling cost. More specifically, to ensure the diversity of selected samples, we propose an active learning method based on multiframe collaboration to select those training samples that should be and need to be annotated. Meanwhile, considering the representativeness of these selected samples, we adopt a nearest-neighbor discrimination method based on the average nearest-neighbor distance to screen isolated samples and low-quality samples. Therefore, the training samples' subset selected based on our method requires only a given budget to maintain the diversity and representativeness of the entire sample set. Furthermore, we adopt a Tversky loss to improve the bounding box estimation of our tracker, which can ensure that the tracker achieves more accurate target states. Extensive experimental results confirm that our active-learning-based tracker (ALT) achieves competitive tracking accuracy and speed compared with state-of-the-art trackers on the seven most challenging evaluation benchmarks. Project website: https://sites.google.com/view/altrack/.

A Real-Time Visual Tracking Approach Using Sparse Autoencoder and Extreme Learning Machine

A low-complexity visual tracking approach with single hidden layer neural networks

Object tracking with 3D LIDAR via multi-task sparse learning

Robust Visual Tracking Method via Deep Learning

Learning a Deep Compact Image Representation for Visual Tracking

Deep Flow Collaborative Network for Online Visual Tracking.

Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking

Multitask Extreme Learning Machine for Visual Tracking

Unsupervised Deep Representation Learning for Real-Time Tracking

Real-time tracking based on deep feature fusion

Non-line-of-sight imaging and tracking of moving objects based on deep learning

DeepTrack: Learning Discriminative Feature Representations Online for Robust Visual Tracking

Adaptive sparse vector hacking via online Bayesian learning

Deep visual tracking: Review and experimental comparison

Effective Real-Time Vehicle Tracking Using Discriminative Sparse Coding on Local Patches

Active Learning for Deep Visual Tracking

Target-Aware Deep Tracking

Discriminative Deep Non-Linear Dictionary Learning for Visual Object Tracking

Non-sparse Linear Representations for Visual Tracking with Online Reservoir Metric Learning

Advances on Application of Deep Learning for Video Ob ject Tracking

Deep Learning based Virtual Point Tracking for Real-Time Target-less Dynamic Displacement Measurement in Railway Applications