Abstract:Named-entity recognition (NER) is one of the primary components in various natural language processing tasks such as relation extraction, information retrieval, question answering, etc. The majority of the research work deals with flat entities. However, it was observed that the entities were often embedded within other entities. Most of the current state-of-the-art models deal with the problem of embedded/nested entity recognition with very complex neural network architectures. In this research work, we proposed to solve the problem of nested named-entity recognition using the transfer-learning approach. For this purpose, different variants of fine-tuned, pretrained, BERT-based language models were used for the problem using the joint-labeling modeling technique. Two nested named-entity-recognition datasets, i.e., GENIA and GermEval 2014, were used for the experiment, with four and two levels of annotation, respectively. Also, the experiments were performed on the JNLPBA dataset, which has flat annotation. The performance of the above models was measured using F1-score metrics, commonly used as the standard metrics to evaluate the performance of named-entity-recognition models. In addition, the performance of the proposed approach was compared with the conditional random field and the Bi-LSTM-CRF model. It was found that the fine-tuned, pretrained, BERT-based models outperformed the other models significantly without requiring any external resources or feature extraction. The results of the proposed models were compared with various other existing approaches. The best-performing BERT-based model achieved F1-scores of 74.38, 85.29, and 80.68 for the GENIA, GermEval 2014, and JNLPBA datasets, respectively. It was found that the transfer learning (i.e., pretrained BERT models after fine-tuning) based approach for the nested named-entity-recognition task could perform well and is a more generalized approach in comparison to many of the existing approaches.

Effect of Depth Order on Iterative Nested Named Entity Recognition Models

Effect of depth order on iterative nested named entity recognition models

A Benchmark of Nested Named Entity Recognition Approaches in Historical Structured Documents

Hierarchical Region Learning for Nested Named Entity Recognition.

A Nested Named Entity Recognition Method for Traditional Chinese Medicine Records

A Sequence-to-Set Network for Nested Named Entity Recognition.

Cascaded Models for Better Fine-Grained Named Entity Recognition

A Unified MRC Framework for Named Entity Recognition

Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition

Ensemble of Deep Masked Language Models for Effective Named Entity Recognition in Health and Life Science Corpora

Nested and Balanced Entity Recognition using Multi-Task Learning

Neural Architectures for Nested NER through Linearization

BERT-Based Transfer-Learning Approach for Nested Named-Entity Recognition Using Joint Labeling

BidH: A Bidirectional Hierarchical Model for Nested Named Entity Recognition

Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction

Recognizing Nested Entities from Flat Supervision: A New NER Subtask, Feasibility and Challenges

Neural Named Entity Recognition from Subword Units

Nested Named Entity Recognition via Second-best Sequence Learning and Decoding

End-to-End Entity Detection with Proposer and Regressor

MMBERT: a unified framework for biomedical named entity recognition