Abstract:Named entity recognition (NER) is a critical subtask in natural language processing. It is particularly valuable to gain a deeper understanding of entity boundaries and entity types when addressing the NER problem. Most previous sequential labeling models are task-specific, while recent years have witnessed the rise of generative models due to the advantage of tackling NER tasks in the encoder–decoder framework. Despite achieving promising performance, our pilot studies demonstrate that existing generative models are ineffective at detecting entity boundaries and estimating entity types. In this paper, a multiple attention framework is proposed which introduces the attention of entity-type embedding and word–word relation into the named entity recognition task. To improve the accuracy of entity-type mapping, we adopt an external knowledge base to calculate the prior entity-type distributions and then incorporate the information input to the model via the encoder's self-attention. To enhance the contextual information, we take the entity types as part of the input. Our method obtains the other attention from the hidden states of entity types and utilizes it in self- and cross-attention mechanisms in the decoder. We transform the entity boundary information in the sequence into word–word relations and extract the corresponding embedding into the cross-attention mechanism. Through word–word relation information, the method can learn and understand more entity boundary information, thereby improving its entity recognition accuracy. We performed experiments on extensive NER benchmarks, including four flat and two long entity benchmarks. Our approach significantly improves or performs similarly to the best generative NER models. The experimental results demonstrate that our method can substantially enhance the capabilities of generative NER models.

Is a Common Phrase an Entity Mention or Not? Dual Representations for Domain-Specific Named Entity Recognition.

Named Entity Analysis and Extraction with Uncommon Words

Unified Named Entity Recognition as Word-Word Relation Classification

Robust Named Entity Recognition in Idiosyncratic Domains

Named Entity Recognition with Bidirectional LSTM-CNNs

Domain-Specific Entity Linking Via Fake Named Entity Detection.

Chinese named entity recognition: The state of the art

Multi-Grained Named Entity Recognition

Incorporating Entity Type-Aware and Word–Word Relation-Aware Attention in Generative Named Entity Recognition

Query-Based Named Entity Recognition

A Unified MRC Framework for Named Entity Recognition

Major Entity Identification: A Generalizable Alternative to Coreference Resolution

Neural Named Entity Recognition from Subword Units

DABC: A Named Entity Recognition Method Incorporating Attention Mechanisms

Unified neural architecture for drug, disease, and clinical entity recognition

LLM-DER:A Named Entity Recognition Method Based on Large Language Models for Chinese Coal Chemical Domain

Neural Entity Reasoner for Global Consistency in NER

MMBERT: a unified framework for biomedical named entity recognition

Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition

S-NER: A Concise and Efficient Span-Based Model for Named Entity Recognition

Entity Synonym Discovery via Multipiece Bilateral Context Matching