Abstract:Convolutional neural networks (CNNs) have been successfully applied to the single target tracking task in recent years. Generally, training a deep CNN model requires numerous labeled training samples, and the number and quality of these samples directly affect the representational capability of the trained model. However, this approach is restrictive in practice, because manually labeling such a large number of training samples is time-consuming and prohibitively expensive. In this article, we propose an active learning method for deep visual tracking, which selects and annotates the unlabeled samples to train the deep CNN model. Under the guidance of active learning, the tracker based on the trained deep CNN model can achieve competitive tracking performance while reducing the labeling cost. More specifically, to ensure the diversity of selected samples, we propose an active learning method based on multiframe collaboration to select those training samples that should be and need to be annotated. Meanwhile, considering the representativeness of these selected samples, we adopt a nearest-neighbor discrimination method based on the average nearest-neighbor distance to screen isolated samples and low-quality samples. Therefore, the training samples' subset selected based on our method requires only a given budget to maintain the diversity and representativeness of the entire sample set. Furthermore, we adopt a Tversky loss to improve the bounding box estimation of our tracker, which can ensure that the tracker achieves more accurate target states. Extensive experimental results confirm that our active-learning-based tracker (ALT) achieves competitive tracking accuracy and speed compared with state-of-the-art trackers on the seven most challenging evaluation benchmarks. Project website: https://sites.google.com/view/altrack/.

Progressive Multi-Stage Learning for Discriminative Tracking

Visual Object Tracking with Online Sample Selection Via Lasso Regularization.

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Visual Tracking Via Online Discriminative Multiple Instance Metric Learning

Robust Visual Tracking Using Dynamic Classifier Selection with Sparse Representation of Label Noise

Joint Spatio-Temporal Similarity and Discrimination Learning for Visual Tracking

Long-Term Visual Object Tracking Via Continual Learning

Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking

Cascaded Iterative Training Model and Parallel Multi-Classifiers for Visual Object Tracking

DeepTrack: Learning Discriminative Feature Representations Online for Robust Visual Tracking

Self-supervised Discriminative Model Prediction for Visual Tracking

Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Tracking

Discriminative Object Tracking Via Sparse Representation and Online Dictionary Learning

Online Discriminative Tracking with Active Example Selection

Jointly Learning a Multi-class Discriminative Dictionary for Robust Visual Tracking.

Self-Paced Dense Connectivity Learning for Visual Tracking

Enhanced Initialization with Multi-Stage Learning for Robust Visual Tracking

Discriminative feature selection for visual tracking

Progressive Unsupervised Learning for Visual Object Tracking

Visual Tracking with Semi-Supervised Online Weighted Multiple Instance Learning

Active Learning for Deep Visual Tracking