Abstract:Convolutional neural networks (CNNs) have been successfully applied to the single target tracking task in recent years. Generally, training a deep CNN model requires numerous labeled training samples, and the number and quality of these samples directly affect the representational capability of the trained model. However, this approach is restrictive in practice, because manually labeling such a large number of training samples is time-consuming and prohibitively expensive. In this article, we propose an active learning method for deep visual tracking, which selects and annotates the unlabeled samples to train the deep CNN model. Under the guidance of active learning, the tracker based on the trained deep CNN model can achieve competitive tracking performance while reducing the labeling cost. More specifically, to ensure the diversity of selected samples, we propose an active learning method based on multiframe collaboration to select those training samples that should be and need to be annotated. Meanwhile, considering the representativeness of these selected samples, we adopt a nearest-neighbor discrimination method based on the average nearest-neighbor distance to screen isolated samples and low-quality samples. Therefore, the training samples' subset selected based on our method requires only a given budget to maintain the diversity and representativeness of the entire sample set. Furthermore, we adopt a Tversky loss to improve the bounding box estimation of our tracker, which can ensure that the tracker achieves more accurate target states. Extensive experimental results confirm that our active-learning-based tracker (ALT) achieves competitive tracking accuracy and speed compared with state-of-the-art trackers on the seven most challenging evaluation benchmarks. Project website: https://sites.google.com/view/altrack/.

Visualization-Based Active Learning for Video Annotation.

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Are Binary Annotations Sufficient? Video Moment Retrieval Via Hierarchical Uncertainty-Based Active Learning

Online Multi-Label Active Annotation

Interactive Video Indexing with Statistical Active Learning

Literature survey of active learning in multimedia annotation and retrieval

Active Learning for Video Classification with Frame Level Queries

Exploring Representativeness and Informativeness for Active Learning.

Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization

Towards Active Learning for Action Spotting in Association Football Videos

Video Annotator: A framework for efficiently building video classifiers using vision-language models and active learning

Visualization Assessment - A Machine Learning Approach.

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

Unlabeled data selection for active learning in image classification

Active Learning With Sampling by Uncertainty and Density for Data Annotations

Active Learning for Video Description with Cluster-Regularized Ensemble Ranking

Semantic-gap-oriented active learning for multilabel image annotation.

Bad Students Make Great Teachers: Active Learning Accelerates Large-Scale Visual Understanding

Active Learning for Deep Visual Tracking

Diverse Expected Gradient Active Learning for Relative Attributes.