Abstract:In multi-label learning, each instance simultaneously associates with multiple labels, which means that labeling such instances is quite costly. Active learning, as an important machine learning paradigm, learns the classification model by querying merely a small portion of data with important information, by means of which, the labeling cost can be greatly reduced during the training process and an accurate and robust classification model could be obtained. Therefore, multi-label active learning (MLAL) has garnered increasing attentions. The primary challenge in MLAL lies in designing an effective query strategy to measure uniform information about unlabeled instances throughout all labels. In this study, we propose a query strategy named predicted label vectors inconsistency and cross entropy measure (PLVI-CE) that considers both uncertainty and diversity measures. In PLVI-CE, the uncertainty is measured by the inconsistency between two predicted label vectors from the same unlabeled instance, and the diversity is assessed by the average discrepancy in posterior probabilities between each unlabeled instance and all instances in the labeled set. Furthermore, in this study, we try to adopt label-weighted extreme learning machine (LW-ELM) as the base classifier in the MLAL framework with considering its following advantages: (1) LW-ELM has a low computational cost, (2) LW-ELM has strong generalization performance, and (3) LW-ELM can be directly used to classify multi-label data with class imbalance distributions, hence providing approximately unbiased instance querying during MLAL. Experimental results on 12 benchmark multi-label datasets indicate the effectiveness and superiority of the proposed PLVI-CE algorithm in comparison with several current state-of-the-art MLAL algorithms.

Active Query Driven By Uncertainty And Diversity For Incremental Multi-Label Learning

Uncertainty-aware Complementary Label Queries for Active Learning

Multi-class active learning by integrating uncertainty and diversity

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Robust and Discriminative Labeling for Multi-label Active Learning Based on Maximum Correntropy Criterion

PLVI-CE: a multi-label active learning algorithm with simultaneously considering uncertainty and diversity

A Multicriterion Query-Based Batch Mode Active Learning Technique

A Cost-sensitive Active Learning for Imbalance Data with Uncertainty and Diversity Combination

Multi-Label Active Learning Based On Maximum Correntropy Criterion: Towards Robust And Discriminative Labeling

Cost-Effective Active Learning from Diverse Labelers.

An active learning approach with uncertainty, representativeness, and diversity.

Active Multi-label Learning with Optimal Label Subset Selection

Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization

Cost-effective Batch-mode Multi-label Active Learning

A Two-Stage Active Learning Method for Image Classification

Multi-Label Bayesian Active Learning with Inter-Label Relationships

Instance-Label Based Multi-Label Active Learning by Evolutionary Multi-Objective Optimization.

Multi-label Active Learning: Query Type Matters

Cost Effective Multi-label Active Learning Via Querying Subexamples

Attribute and Label Distribution Driven Multi-Label Active Learning