Abstract:Named entity recognition (NER) is a critical subtask in natural language processing. It is particularly valuable to gain a deeper understanding of entity boundaries and entity types when addressing the NER problem. Most previous sequential labeling models are task-specific, while recent years have witnessed the rise of generative models due to the advantage of tackling NER tasks in the encoder–decoder framework. Despite achieving promising performance, our pilot studies demonstrate that existing generative models are ineffective at detecting entity boundaries and estimating entity types. In this paper, a multiple attention framework is proposed which introduces the attention of entity-type embedding and word–word relation into the named entity recognition task. To improve the accuracy of entity-type mapping, we adopt an external knowledge base to calculate the prior entity-type distributions and then incorporate the information input to the model via the encoder's self-attention. To enhance the contextual information, we take the entity types as part of the input. Our method obtains the other attention from the hidden states of entity types and utilizes it in self- and cross-attention mechanisms in the decoder. We transform the entity boundary information in the sequence into word–word relations and extract the corresponding embedding into the cross-attention mechanism. Through word–word relation information, the method can learn and understand more entity boundary information, thereby improving its entity recognition accuracy. We performed experiments on extensive NER benchmarks, including four flat and two long entity benchmarks. Our approach significantly improves or performs similarly to the best generative NER models. The experimental results demonstrate that our method can substantially enhance the capabilities of generative NER models.

Informed Named Entity Recognition Decoding for Generative Language Models

GEIC: Universal and Multilingual Named Entity Recognition with Large Language Models

Retrieval-Enhanced Named Entity Recognition

ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models

Instructed Language Models with Retrievers Are Powerful Entity Linkers

Towards Robust Named Entity Recognition for Historic German

ToNER: Type-oriented Named Entity Recognition with Generative Language Model

GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformer

Cascaded Models for Better Fine-Grained Named Entity Recognition

Neural Named Entity Recognition from Subword Units

Incorporating Entity Type-Aware and Word–Word Relation-Aware Attention in Generative Named Entity Recognition

Ernie: Enhanced Language Representation With Informative Entities

Incorporating Large Language Models into Named Entity Recognition: Opportunities and Challenges

BTPK-based learning: An Interpretable Method for Named Entity Recognition

Robust Named Entity Recognition in Idiosyncratic Domains

GPT-NER: Named Entity Recognition via Large Language Models

Rethinking Negative Instances for Generative Named Entity Recognition

Inspire the Large Language Model by External Knowledge on BioMedical Named Entity Recognition

NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data

Hero-Gang Neural Model For Named Entity Recognition