Abstract:Named entity recognition (NER) for identifying proper nouns in unstructured text is one of the most important and fundamental tasks in natural language processing. However, despite the widespread use of NER models, they still require a large-scale labeled data set, which incurs a heavy burden due to manual annotation. Domain adaptation is one of the most promising solutions to this problem, where rich labeled data from the relevant source domain are utilized to strengthen the generalizability of a model based on the target domain. However, the mainstream cross-domain NER models are still affected by the following two challenges (1) Extracting domain-invariant information such as syntactic information for cross-domain transfer. (2) Integrating domain-specific information such as semantic information into the model to improve the performance of NER. In this study, we present a semi-supervised framework for transferable NER, which disentangles the domain-invariant latent variables and domain-specific latent variables. In the proposed framework, the domain-specific information is integrated with the domain-specific latent variables by using a domain predictor. The domain-specific and domain-invariant latent variables are disentangled using three mutual information regularization terms, i.e., maximizing the mutual information between the domain-specific latent variables and the original embedding, maximizing the mutual information between the domain-invariant latent variables and the original embedding, and minimizing the mutual information between the domain-specific and domain-invariant latent variables. Extensive experiments demonstrated that our model can obtain state-of-the-art performance with cross-domain and cross-lingual NER benchmark data sets.

Class-Imbalanced-Aware Distantly Supervised Named Entity Recognition

Distantly Supervised Named Entity Recognition Using Positive-Unlabeled Learning.

Distantly-Supervised Named Entity Recognition with Uncertainty-aware Teacher Learning and Student-student Collaborative Learning

Improving the Robustness of Distantly-Supervised Named Entity Recognition via Uncertainty-Aware Teacher Learning and Student-Student Collaborative Learning

Label Refinement Via Contrastive Learning for Distantly-Supervised Named Entity Recognition.

Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-grained Student Ensemble

A Web Semantic-Based Text Analysis Approach for Enhancing Named Entity Recognition Using PU-Learning and Negative Sampling

Learning "O" Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NER.

Better Sampling of Negatives for Distantly Supervised Named Entity Recognition

Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition

Debiased and Denoised Entity Recognition from Distant Supervision.

Majority or Minority: Data Imbalance Learning Method for Named Entity Recognition

Noisy-Labeled NER with Confidence Estimation

A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition

Semi-Supervised Disentangled Framework for Transferable Named Entity Recognition

Self-PU: Self Boosted and Calibrated Positive-Unlabeled Training

Named Entity Recognition Via Noise Aware Training Mechanism with Data Filter.

A Semantically Enhanced Label Prediction Method for Imbalanced POI Data Category Distribution

A Unified Model for Cross-Domain and Semi-Supervised Named Entity Recognition in Chinese Social Media

Mix of Experts Language Model for Named Entity Recognition

MProto: Multi-Prototype Network with Denoised Optimal Transport for Distantly Supervised Named Entity Recognition