Abstract:Active learning is an important learning paradigm in machine learning and data mining, which aims to train effective classifiers with as few labeled samples as possible. Querying discriminative (informative) and representative samples are the state-of-the-art approach for active learning. Fully utilizing a large amount of unlabeled data provides a second chance to improve the performance of active learning. Although there have been several active learning methods proposed by combining with semisupervised learning, fast active learning with fully exploiting unlabeled data and querying discriminative and representative samples is still an open question. To overcome this challenging issue, in this article, we propose a new efficient batch mode active learning algorithm. Specifically, we first provide an active learning risk bound by fully considering the unlabeled samples in characterizing the informativeness and representativeness. Based on the risk bound, we derive a new objective function for batch mode active learning. After that, we propose a wrapper algorithm to solve the objective function, which essentially trains a semisupervised classifier and selects discriminative and representative samples alternately. Especially, to avoid retraining the semisupervised classifier from scratch after each query, we design two unique procedures based on the path-following technique, which can remove multiple queried samples from the unlabeled data set and add the queried samples into the labeled data set efficiently. Extensive experimental results on a variety of benchmark data sets not only show that our algorithm has a better generalization performance than the state-of-the-art active learning approaches but also show its significant efficiency.

Label Shift Conditioned Hybrid Querying for Deep Active Learning

Uncertainty-aware Complementary Label Queries for Active Learning

Learning with Both Unlabeled Data and Query Logs for Image Search.

Hybrid Sharing for Multi-Label Image Classification

Online Multi-Label Classification under Noisy and Changing Label Distribution

Learning Label Shift Correction for Test-Agnostic Long-Tailed Recognition

Asynchronous Active Learning with Distributed Label Querying

Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iterate

Active Learning from Weak and Strong Labelers

Multi-label Active Learning: Query Type Matters

Active Query Driven By Uncertainty And Diversity For Incremental Multi-Label Learning

Active Learning Without Knowing Individual Instance Labels: A Pairwise Label Homogeneity Query Approach.

Theory-inspired Label Shift Adaptation via Aligned Distribution Mixture

Addressing practical challenges in Active Learning via a hybrid query strategy

Adapting to Online Label Shift with Provable Guarantees

Efficient Human-in-the-Loop Active Learning: A Novel Framework for Data Labeling in AI Systems

Efficient Active Learning by Querying Discriminative and Representative Samples and Fully Exploiting Unlabeled Data

Two-dimensional multilabel active learning with an efficient online adaptation model for image classification.

When Invariant Representation Learning Meets Label Shift: Insufficiency and Theoretical Insights

Semi-automatic Labeling with Active Learning for Multi-label Image Classification.

Learning Generalizable Batch Active Learning Strategies Via Deep Q-networks (student Abstract).