Abstract: The task of named entity recognition (NER) is normally divided into nested NER and flat NER depending on whether named entities are nested or not. Models are usually separately developed for the two tasks, since sequence labeling models, the most widely used backbone for flat NER, are only able to assign a single label to a particular token, which is unsuitable for nested NER where a token may be assigned several labels. In this paper, we propose a unified framework that is capable of handling both flat and nested NER tasks. Instead of treating the task of NER as a sequence labeling problem, we propose to formulate it as a machine reading comprehension (MRC) task. For example, extracting entities with the \textsc{per} label is formalized as extracting answer spans to the question "{\it which person is mentioned in the text?}". This formulation naturally tackles the entity overlapping issue in nested NER: the extraction of two overlapping entities for different categories requires answering two independent questions. Additionally, since the query encodes informative prior knowledge, this strategy facilitates the process of entity extraction, leading to better performances for not only nested NER, but flat NER. We conduct experiments on both {\em nested} and {\em flat} NER datasets. Experimental results demonstrate the effectiveness of the proposed formulation. We are able to achieve vast amount of performance boost over current SOTA models on nested NER datasets, i.e., +1.28, +2.55, +5.44, +6.37, respectively on ACE04, ACE05, GENIA and KBP17, along with SOTA results on flat NER datasets, i.e.,+0.24, +1.95, +0.21, +1.49 respectively on English CoNLL 2003, English OntoNotes 5.0, Chinese MSRA, Chinese OntoNotes 4.0.

Towards Malay named entity recognition: an open-source dataset and a multi-task framework

An Open-Source Dataset and A Multi-Task Model for Malay Named Entity Recognition

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition

Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach

MMBERT: a unified framework for biomedical named entity recognition

Adversarial Multi-Task Learning for Efficient Chinese Named Entity Recognition

A Multi-task Approach for Machine Reading Comprehension Form Named Entity Recognition Tasks

Pronounce Differently, Mean Differently: A Multi-Tagging-scheme Learning Method for Chinese NER Integrated with Lexicon and Phonetic Features

Enhancing Low Resource NER Using Assisting Language And Transfer Learning

DMNER: Biomedical Entity Recognition by Detection and Matching

Dataset-aware multi-task learning approaches for biomedical named entity recognition

Bridging the Gap: Transfer Learning from English PLMs to Malaysian English

A Multi-way Parallel Named Entity Annotated Corpus for English, Tamil and Sinhala

Chinese Named Entity Recognition with a Multi-Phase Model

BioMNER: A Dataset for Biomedical Method Entity Recognition

Towards Lingua Franca Named Entity Recognition with BERT

What Matters for Neural Cross-Lingual Named Entity Recognition: An Empirical Analysis

A Unified MRC Framework for Named Entity Recognition

NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval

CL-NERIL: A Cross-Lingual Model for NER in Indian Languages