Abstract:When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in order to improve the previous model and gain in generalization. In deep learning, active learning is usually implemented as an iterative process in which successive deep models are updated via fine tuning, but it still poses some issues. First, the initial batch of annotated images has to be sufficiently large to train a deep model. Such an assumption is strong, especially when the total annotation budget is reduced. We tackle this issue by using an approach inspired by transfer learning. A pre-trained model is used as a feature extractor and only shallow classifiers are learned during the active iterations. The second issue is the effectiveness of probability or feature estimates of early models for AL task. Samples are generally selected for annotation using acquisition functions based only on the last learned model. We introduce a novel acquisition function which exploits the iterative nature of AL process to select samples in a more robust fashion. Samples for which there is a maximum shift towards uncertainty between the last two learned models predictions are favored. A diversification step is added to select samples from different regions of the classification space and thus introduces a representativeness component in our approach. Evaluation is done against competitive methods with three balanced and imbalanced datasets and outperforms them.

Counterfactual Active Learning for Out-of-Distribution Generalization.

Uncertainty-aware Complementary Label Queries for Active Learning

Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning

Practical Obstacles to Deploying Active Learning

Learning Distinctive Margin Toward Active Domain Adaptation

Improving Classifier Robustness through Active Generation of Pairwise Counterfactuals

Optimizing Active Learning for Low Annotation Budgets

A Generative Adversarial Active Learning Method for Effective Outlier Detection

Composite Active Learning: Towards Multi-Domain Active Learning with Theoretical Guarantees

Domain Adversarial Active Learning for Domain Generalization Classification

Deep Individual Active Learning: Safeguarding Against Out-of-Distribution Challenges in Neural Networks

ALVIN: Active Learning Via INterpolation

Pareto Optimization for Active Learning under Out-of-Distribution Data Scenarios

Bidirectional Uncertainty-Based Active Learning for Open Set Annotation

Enhancing Counterfactual Classification via Self-Training

Inductive State-Relabeling Adversarial Active Learning with Heuristic Clique Rescaling

Exploiting counter-examples for active learning with partial labels

Discovering General-Purpose Active Learning Strategies

Teaching Small Language Models Reasoning Through Counterfactual Distillation

Dirichlet-Based Coarse-to-Fine Example Selection For Open-Set Annotation

LOG: Active Model Adaptation for Label-Efficient OOD Generalization