Abstract:Named Entity Recognition (NER) is the fundamental task for Natural Language Processing (NLP) and the initial step in building a Knowledge Graph (KG). Recently, BERT (Bidirectional Encoder Representations from Transformers), which is a pre-training model, has achieved state-of-the-art (SOTA) results in various NLP tasks, including the NER. However, Chinese NER is still a more challenging task for BERT because there are no physical separations between Chinese words, and BERT can only obtain the representations of Chinese characters. Nevertheless, the Chinese NER cannot be well handled with character-level representations, because the meaning of a Chinese word is quite different from that of the characters, which make up the word. ERNIE (Enhanced Representation through kNowledge IntEgration), which is an improved pre-training model of BERT, is more suitable for Chinese NER because it is designed to learn language representations enhanced by the knowledge masking strategy. However, the potential of ERNIE has not been fully explored. ERNIE only utilizes the token-level features and ignores the sentence-level feature when performing the NER task. In this paper, we propose the ERNIE-Joint, which is a joint model based on ERNIE. The ERNIE-Joint can utilize both the sentence-level and token-level features by joint training the NER and text classification tasks. In order to use the raw NER datasets for joint training and avoid additional annotations, we perform the text classification task according to the number of entities in the sentences. The experiments are conducted on two datasets: MSRA-NER and Weibo. These datasets contain Chinese news data and Chinese social media data, respectively. The results demonstrate that the ERNIE-Joint not only outperforms BERT and ERNIE but also achieves the SOTA results on both datasets.

An InterFormer-BERT Chinese Named Entity Recognition Model with Enhanced Boundary

KCB-FLAT: Enhancing Chinese Named Entity Recognition with Syntactic Information and Boundary Smoothing Techniques

Enhanced Chinese Domain Named Entity Recognition: An Approach with Lexicon Boundary and Frequency Weight Features

Chinese Named-Entity Recognition Via Self-Attention Mechanism and Position-Aware Influence Propagation Embedding

A Boundary Regression Model for Nested Named Entity Recognition

Integrating Boundary Assembling into a DNN Framework for Named Entity Recognition in Chinese Social Media Text

Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer

An Improved Chinese Named Entity Recognition Method with TB-LSTM-CRF

Attack Named Entity Recognition by Entity Boundary Interference

A hybrid Transformer approach for Chinese NER with features augmentation

A Local Information Perception Enhancement–Based Method for Chinese NER

An ERNIE-Based Joint Model for Chinese Named Entity Recognition

Adversarial Multi-Task Learning for Efficient Chinese Named Entity Recognition

A Toponym Entity Recognition Model for Chinese Social Media

ELCA: Enhanced boundary location for Chinese named entity recognition via contextual association

A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis

DBM-CNER: A Dual-Branch Multifeature Model for Chinese Named Entity Recognition.

A Chinese named entity recognition model: integrating label knowledge and lexicon information

LB-BMBC: MHBiaffine-CNN to Capture Span Scores with BERT Injected with Lexical Information for Chinese NER

Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism.

A Boundary Offset Prediction Network for Named Entity Recognition