Abstract:Currently, named entity recognition (NER) is mainly evaluated on standard and well-annotated data sets. However, the construction of a well-annotated data set will consume a lot of manpower and time. In lots of applications of NER, data sets may contain a lot of noise, and a large part of noise comes from unlabeled entities. At present, the training process of most models treat unlabeled entities as nonentities, which causes these models to lean toward predicting most words of an input context as nonentities and greatly affects their performances. In this paper, as the first attempt, we innovatively propose an adaptive positive-unlabeled (adaPU) learning technology, and integrate the adaPU into a machine reading comprehension (MRC) framework for NER, which can still perform well on data sets with a large proportion of unlabeled entities. In our framework, to leverage the above problem that a model may predict most words of an input context as nonentities, we propose an adaPU learning technology by adjusting a loss coefficient of positive and negative samples. Moreover, instead of just constructing a fixed query for each entity type as input to MRC, we propose a new method of dynamically constructing multiple queries for each entity type, which also brings slight performance improvement for NER. Accordingly, we explore new training and entity inference strategies for our learning framework. The experimental results show that our framework is effective on data sets that contain a large number of unlabeled entities. When the proportion of unlabeled entities reaches 50%, our framework still can keep from losing effectiveness and maintain more than 80 F1-scores on several data sets. Also, the experiments show that our framework can achieve better or competitive performance on standard data sets. The ablation experiments further fully demonstrate our MRC framework with adaPU learning and dynamic query construction method can improve the performance of NER.

Learning to select pseudo labels: a semi-supervised method for named entity recognition

Distantly Supervised Named Entity Recognition Using Positive-Unlabeled Learning.

Learning to Label with Active Learning and Reinforcement Learning.

Improving Pseudo Labels with Global-Local Denoising Framework for Cross-lingual Named Entity Recognition

An Unsupervised Learning Approach for NER Based on Online Encyclopedia.

Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning.

Uncertainty-Aware Contrastive Learning for Semi-Supervised Named Entity Recognition

Class-Imbalanced-Aware Distantly Supervised Named Entity Recognition

Improving Distantly-Supervised Named Entity Recognition for Traditional Chinese Medicine Text Via a Novel Back-Labeling Approach.

Label Refinement Via Contrastive Learning for Distantly-Supervised Named Entity Recognition.

Semi-Supervised Bidirectional Long Short-Term Memory and Conditional Random Fields Model for Named-Entity Recognition Using Embeddings from Language Models Representations

Pseudo-label Selection for Deep Semi-supervised Learning

Research on Named Entity Recognition in Chinese EMR Based on Semi-Supervised Learning with Dual Selected Strategy.

Distantly-Supervised Named Entity Recognition with Uncertainty-aware Teacher Learning and Student-student Collaborative Learning

An MRC and Adaptive Positive‐unlabeled Learning Framework for Incompletely Labeled Named Entity Recognition

A pre-training and self-training approach for biomedical named entity recognition

Chinese Named Entity Recognition Method for Domain-Specific Text

Improving the Robustness of Distantly-Supervised Named Entity Recognition via Uncertainty-Aware Teacher Learning and Student-Student Collaborative Learning

SNER: Semi-supervised Named Entity Recognition for Large Volume of Diabetes Data

Enhancing Chinese Word Segmentation Via Pseudo Labels for Practicability

Named entity recognition based on semi-supervised ensemble learning with the improved tri-training algorithm