Abstract:ABSTRACTActive learning has been proven to be effective in reducing labeling efforts for supervised learning. However, existing active learning work has mainly focused on training models for a single domain. In practical applications, it is common to simultaneously train classifiers for multiple domains. For example, some merchant web sites (like Amazon.com) may need a set of classifiers to predict the sentiment polarity of product reviews collected from various domains (e.g., electronics, books, shoes). Though different domains have their own unique features, they may share some common latent features. If we apply active learning on each domain separately, some data instances selected from different domains may contain duplicate knowledge due to the common features. Therefore, how to choose the data from multiple domains to label is crucial to further reducing the human labeling efforts in multi-domain learning. In this paper, we propose a novel multi-domain active learning framework to jointly select data instances from all domains with duplicate information considered. In our solution, a shared subspace is first learned to represent common latent features of different domains. By considering the common and the domain-specific features together, the model loss reduction induced by each data instance can be decomposed into a common part and a domain-specific part. In this way, the duplicate information across domains can be encoded into the common part of model loss reduction and taken into account when querying. We compare our method with the state-of-the-art active learning approaches on several text classification tasks: sentiment classification, newsgroup classification and email spam filtering. The experiment results show that our method reduces the human labeling efforts by 33.2%, 42.9% and 68.7% on the three tasks, respectively.

A Language Model Adaptation Approach Based on Text Classification.

Language Model Adaptation Based on the Classification of a Trigram's Language Style Feature

Language model adaptation based on correction information for interactive speech transcription

Improving Domain Adaptation through Extended-Text Reading Comprehension

CLMAD: A Chinese Language Model Adaptation Dataset

A Public Chinese Dataset for Language Model Adaptation

Correction Focused Language Model Training for Speech Recognition

A Smoothing Algorithm For The Task Adaptation Chinese Trigram Model

Adaptable and Reliable Text Classification using Large Language Models

Reinforcing Language Model For Speech Translation With Auxiliary Data

Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models

Alignment Model Adaptation for Domain-Specific Word Alignment.

Text-only Domain Adaptation using Unified Speech-Text Representation in Transducer

Language Model Weight Adaptation Based on Cross-entropy for Statistical Machine Translation

Methodology of Adapting Large English Language Models for Specific Cultural Contexts

A Curriculum Learning Approach for Multi-Domain Text Classification Using Keyword Weight Ranking

AdaptEval: Evaluating Large Language Models on Domain Adaptation for Text Summarization

Evaluating and Mitigating Linguistic Discrimination in Large Language Models

A discriminative model selection approach and its application to text classification

Translation Model Adaptation for Statistical Machine Translation with Monolingual Topic Information.

Multi-domain active learning for text classification.