Abstract:Currently, named entity recognition (NER) is mainly evaluated on standard and well-annotated data sets. However, the construction of a well-annotated data set will consume a lot of manpower and time. In lots of applications of NER, data sets may contain a lot of noise, and a large part of noise comes from unlabeled entities. At present, the training process of most models treat unlabeled entities as nonentities, which causes these models to lean toward predicting most words of an input context as nonentities and greatly affects their performances. In this paper, as the first attempt, we innovatively propose an adaptive positive-unlabeled (adaPU) learning technology, and integrate the adaPU into a machine reading comprehension (MRC) framework for NER, which can still perform well on data sets with a large proportion of unlabeled entities. In our framework, to leverage the above problem that a model may predict most words of an input context as nonentities, we propose an adaPU learning technology by adjusting a loss coefficient of positive and negative samples. Moreover, instead of just constructing a fixed query for each entity type as input to MRC, we propose a new method of dynamically constructing multiple queries for each entity type, which also brings slight performance improvement for NER. Accordingly, we explore new training and entity inference strategies for our learning framework. The experimental results show that our framework is effective on data sets that contain a large number of unlabeled entities. When the proportion of unlabeled entities reaches 50%, our framework still can keep from losing effectiveness and maintain more than 80 F1-scores on several data sets. Also, the experiments show that our framework can achieve better or competitive performance on standard data sets. The ablation experiments further fully demonstrate our MRC framework with adaPU learning and dynamic query construction method can improve the performance of NER.

A Web Semantic-Based Text Analysis Approach for Enhancing Named Entity Recognition Using PU-Learning and Negative Sampling

Distantly Supervised Named Entity Recognition Using Positive-Unlabeled Learning.

An MRC and Adaptive Positive‐unlabeled Learning Framework for Incompletely Labeled Named Entity Recognition

Better Sampling of Negatives for Distantly Supervised Named Entity Recognition

Class-Imbalanced-Aware Distantly Supervised Named Entity Recognition

A Local Information Perception Enhancement–Based Method for Chinese NER

Learning to select pseudo labels: a semi-supervised method for named entity recognition

Chinese Named Entity Recognition Method for Domain-Specific Text

Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition

Distantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled Learning

Enhanced Chinese Domain Named Entity Recognition: An Approach with Lexicon Boundary and Frequency Weight Features

Enhancing NER with Sentence-Level Entity Detection As an Simple Auxiliary Task

Handling Negative Samples Problems in Span-Based Nested Named Entity Recognition

Mitigating Out-of-Entity Errors in Named Entity Recognition: A Sentence-Level Strategy

Rethinking Negative Instances for Generative Named Entity Recognition

Few-shot named entity recognition with hybrid multi-prototype learning

Entity Similarity-Based Negative Sampling for Knowledge Graph Embedding

IMPROVING NER IN SOCIAL MEDIA VIA ENTITY TYPE-COMPATIBLE UNKNOWN WORD SUBSTITUTION

Bootstrapping Large-scale Named Entities Using URL-Text Hybrid Patterns.

PENNER: Pattern-enhanced Nested Named Entity Recognition in Biomedical Literature