Abstract:Named entity recognition (NER) for identifying proper nouns in unstructured text is one of the most important and fundamental tasks in natural language processing. However, despite the widespread use of NER models, they still require a large-scale labeled data set, which incurs a heavy burden due to manual annotation. Domain adaptation is one of the most promising solutions to this problem, where rich labeled data from the relevant source domain are utilized to strengthen the generalizability of a model based on the target domain. However, the mainstream cross-domain NER models are still affected by the following two challenges (1) Extracting domain-invariant information such as syntactic information for cross-domain transfer. (2) Integrating domain-specific information such as semantic information into the model to improve the performance of NER. In this study, we present a semi-supervised framework for transferable NER, which disentangles the domain-invariant latent variables and domain-specific latent variables. In the proposed framework, the domain-specific information is integrated with the domain-specific latent variables by using a domain predictor. The domain-specific and domain-invariant latent variables are disentangled using three mutual information regularization terms, i.e., maximizing the mutual information between the domain-specific latent variables and the original embedding, maximizing the mutual information between the domain-invariant latent variables and the original embedding, and minimizing the mutual information between the domain-specific and domain-invariant latent variables. Extensive experiments demonstrated that our model can obtain state-of-the-art performance with cross-domain and cross-lingual NER benchmark data sets.

Improving Named Entity Recognition Via Bridge-based Domain Adaptation

Named Entity Recognition for Fusion Bridge Generation Strategies

mCL-NER: Cross-Lingual Named Entity Recognition via Multi-view Contrastive Learning

Neural Adaptation Layers for Cross-domain Named Entity Recognition

Cross-domain Named Entity Recognition via Graph Matching

Three Heads Are Better Than One: Improving Cross-Domain NER with Progressive Decomposed Network

Cross-domain NER under a Divide-and-Transfer Paradigm

A Double Adversarial Network Model for Multi-Domain and Multi-Task Chinese Named Entity Recognition

Domain Adaptation for Named Entity Recognition in Online Media with Word Embeddings

Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignment

One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER

Enhanced Chinese Domain Named Entity Recognition: An Approach with Lexicon Boundary and Frequency Weight Features

Bridge inspection named entity recognition via BERT and lexicon augmented machine reading comprehension neural model

Semi-Supervised Disentangled Framework for Transferable Named Entity Recognition

Unsupervised cross-domain named entity recognition using entity-aware adversarial training

Cross-Lingual Named Entity Recognition Based on Attention and Adversarial Training

Cross-Lingual Named Entity Recognition Using Parallel Corpus: A New Approach Using XLM-RoBERTa Alignment

A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition

KCB-FLAT: Enhancing Chinese Named Entity Recognition with Syntactic Information and Boundary Smoothing Techniques

PRAM: An End-to-end Prototype-based Representation Alignment Model for Zero-resource Cross-lingual Named Entity Recognition

Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognition