Abstract:ABSTRACTActive learning has been proven to be effective in reducing labeling efforts for supervised learning. However, existing active learning work has mainly focused on training models for a single domain. In practical applications, it is common to simultaneously train classifiers for multiple domains. For example, some merchant web sites (like Amazon.com) may need a set of classifiers to predict the sentiment polarity of product reviews collected from various domains (e.g., electronics, books, shoes). Though different domains have their own unique features, they may share some common latent features. If we apply active learning on each domain separately, some data instances selected from different domains may contain duplicate knowledge due to the common features. Therefore, how to choose the data from multiple domains to label is crucial to further reducing the human labeling efforts in multi-domain learning. In this paper, we propose a novel multi-domain active learning framework to jointly select data instances from all domains with duplicate information considered. In our solution, a shared subspace is first learned to represent common latent features of different domains. By considering the common and the domain-specific features together, the model loss reduction induced by each data instance can be decomposed into a common part and a domain-specific part. In this way, the duplicate information across domains can be encoded into the common part of model loss reduction and taken into account when querying. We compare our method with the state-of-the-art active learning approaches on several text classification tasks: sentiment classification, newsgroup classification and email spam filtering. The experiment results show that our method reduces the human labeling efforts by 33.2%, 42.9% and 68.7% on the three tasks, respectively.

Learning to Label with Active Learning and Reinforcement Learning.

Human-centred Design on Crowdsourcing Annotation Towards Improving Active Learning Model Performance

Data : Labeler 1 : Labeler 2 : Labeler 3 : Figure

Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

Cost-Effective Active Learning from Diverse Labelers.

Learning to Name Faces

Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognition

ActiveLab: Active Learning with Re-Labeling by Multiple Annotators

Focusing on Potential Named Entities During Active Label Acquisition

Active Learning for NLP with Large Language Models

LTNER: Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Marking

STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models

Multi-domain active learning for text classification.

LLMaAA: Making Large Language Models as Active Annotators

LTP: A New Active Learning Strategy for CRF-Based Named Entity Recognition

Synergistic Training: Harnessing Active Learning and Pseudo-Labeling for Enhanced Model Performance in Deep Learning

Low-Resource Name Tagging Learned with Weakly Labeled Data

Just Label What You Need: Fine-Grained Active Selection for Perception and Prediction through Partially Labeled Scenes

A Simple yet Effective Framework for Active Learning to Rank

Semi-automatic Labeling with Active Learning for Multi-label Image Classification.

Label Smarter, Not Harder: CleverLabel for Faster Annotation of Ambiguous Image Classification with Higher Quality