Abstract:In multi-label learning, each instance simultaneously associates with multiple labels, which means that labeling such instances is quite costly. Active learning, as an important machine learning paradigm, learns the classification model by querying merely a small portion of data with important information, by means of which, the labeling cost can be greatly reduced during the training process and an accurate and robust classification model could be obtained. Therefore, multi-label active learning (MLAL) has garnered increasing attentions. The primary challenge in MLAL lies in designing an effective query strategy to measure uniform information about unlabeled instances throughout all labels. In this study, we propose a query strategy named predicted label vectors inconsistency and cross entropy measure (PLVI-CE) that considers both uncertainty and diversity measures. In PLVI-CE, the uncertainty is measured by the inconsistency between two predicted label vectors from the same unlabeled instance, and the diversity is assessed by the average discrepancy in posterior probabilities between each unlabeled instance and all instances in the labeled set. Furthermore, in this study, we try to adopt label-weighted extreme learning machine (LW-ELM) as the base classifier in the MLAL framework with considering its following advantages: (1) LW-ELM has a low computational cost, (2) LW-ELM has strong generalization performance, and (3) LW-ELM can be directly used to classify multi-label data with class imbalance distributions, hence providing approximately unbiased instance querying during MLAL. Experimental results on 12 benchmark multi-label datasets indicate the effectiveness and superiority of the proposed PLVI-CE algorithm in comparison with several current state-of-the-art MLAL algorithms.

Integrating Informativeness, Representativeness and Diversity in Pool-Based Sequential Active Learning for Regression

Uncertainty-aware Complementary Label Queries for Active Learning

Exploring Representativeness and Informativeness for Active Learning.

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

ALdataset: a benchmark for pool-based active learning

Interactive Active Learning for Fairness with Partial Group Label

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

ALVIN: Active Learning Via INterpolation

Meta-Learning Transferable Active Learning Policies by Deep Reinforcement Learning

A Graph-Based Approach for Active Learning in Regression

PLVI-CE: a multi-label active learning algorithm with simultaneously considering uncertainty and diversity

Active Learning Query Strategies for Linear Regression Based on Efficient Global Optimization

AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets

Exploring Diversity-based Active Learning for 3D Object Detection in Autonomous Driving

Adaptive Learning for Dynamic Features and Noisy Labels

Optimizing Active Learning for Low Annotation Budgets

Active Learning Through Label Error Statistical Methods

Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization

Reinforcement Online Active Learning Ensemble for Drifting Imbalanced Data Streams

A Serial Sample Selection Framework for Active Learning.