Abstract:ABSTRACTActive learning has been proven to be effective in reducing labeling efforts for supervised learning. However, existing active learning work has mainly focused on training models for a single domain. In practical applications, it is common to simultaneously train classifiers for multiple domains. For example, some merchant web sites (like Amazon.com) may need a set of classifiers to predict the sentiment polarity of product reviews collected from various domains (e.g., electronics, books, shoes). Though different domains have their own unique features, they may share some common latent features. If we apply active learning on each domain separately, some data instances selected from different domains may contain duplicate knowledge due to the common features. Therefore, how to choose the data from multiple domains to label is crucial to further reducing the human labeling efforts in multi-domain learning. In this paper, we propose a novel multi-domain active learning framework to jointly select data instances from all domains with duplicate information considered. In our solution, a shared subspace is first learned to represent common latent features of different domains. By considering the common and the domain-specific features together, the model loss reduction induced by each data instance can be decomposed into a common part and a domain-specific part. In this way, the duplicate information across domains can be encoded into the common part of model loss reduction and taken into account when querying. We compare our method with the state-of-the-art active learning approaches on several text classification tasks: sentiment classification, newsgroup classification and email spam filtering. The experiment results show that our method reduces the human labeling efforts by 33.2%, 42.9% and 68.7% on the three tasks, respectively.

Multi-label Active Learning Based on Submodular Functions

Active Multi-label Learning with Optimal Label Subset Selection

Uncertainty-aware Complementary Label Queries for Active Learning

Cost Effective Multi-label Active Learning Via Querying Subexamples

Instance-Label Based Multi-Label Active Learning by Evolutionary Multi-Objective Optimization.

Multi-label Active Learning: Query Type Matters

Cost-Effective Active Learning from Diverse Labelers.

Data : Labeler 1 : Labeler 2 : Labeler 3 : Figure

Active Learning Without Knowing Individual Instance Labels: A Pairwise Label Homogeneity Query Approach.

Multi-Label Learning Based on Clustering Optimization

Multi-Label Bayesian Active Learning with Inter-Label Relationships

Active Query Driven By Uncertainty And Diversity For Incremental Multi-Label Learning

Multi-Label Active Learning Based On Maximum Correntropy Criterion: Towards Robust And Discriminative Labeling

Robust and Discriminative Labeling for Multi-label Active Learning Based on Maximum Correntropy Criterion

Adaptive Submodular Meta-Learning

Active Learning by Querying Informative and Representative Examples.

Multi-domain active learning for text classification.

Sample Diversity Selection Strategy Based on Label Distribution Morphology for Active Label Distribution Learning

Semi-automatic Labeling with Active Learning for Multi-label Image Classification.

Perturbation-Based Two-Stage Multi-Domain Active Learning

Effective Multi-Label Active Learning for Text Classification