Abstract:Named Entity Recognition (NER) is the fundamental task for Natural Language Processing (NLP) and the initial step in building a Knowledge Graph (KG). Recently, BERT (Bidirectional Encoder Representations from Transformers), which is a pre-training model, has achieved state-of-the-art (SOTA) results in various NLP tasks, including the NER. However, Chinese NER is still a more challenging task for BERT because there are no physical separations between Chinese words, and BERT can only obtain the representations of Chinese characters. Nevertheless, the Chinese NER cannot be well handled with character-level representations, because the meaning of a Chinese word is quite different from that of the characters, which make up the word. ERNIE (Enhanced Representation through kNowledge IntEgration), which is an improved pre-training model of BERT, is more suitable for Chinese NER because it is designed to learn language representations enhanced by the knowledge masking strategy. However, the potential of ERNIE has not been fully explored. ERNIE only utilizes the token-level features and ignores the sentence-level feature when performing the NER task. In this paper, we propose the ERNIE-Joint, which is a joint model based on ERNIE. The ERNIE-Joint can utilize both the sentence-level and token-level features by joint training the NER and text classification tasks. In order to use the raw NER datasets for joint training and avoid additional annotations, we perform the text classification task according to the number of entities in the sentences. The experiments are conducted on two datasets: MSRA-NER and Weibo. These datasets contain Chinese news data and Chinese social media data, respectively. The results demonstrate that the ERNIE-Joint not only outperforms BERT and ERNIE but also achieves the SOTA results on both datasets.

ERNIE-AT-CEL: A Chinese Few-Shot Emerging Entity Linking Model Based on ERNIE and Adversarial Training.

An ERNIE-Based Joint Model for Chinese Named Entity Recognition

Enhanced Character Embedding for Chinese Short Text Entity Linking

Overview of NLPCC 2023 Shared Task 6: Chinese Few-Shot and Zero-Shot Entity Linking.

Improving Few-shot and Zero-shot Entity Linking with Coarse-to-Fine Lexicon-based Retriever

OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model Prompting

Effective Few-Shot Named Entity Linking by Meta-Learning

HTLinker: A Head-to-Tail Linker for Nested Named Entity Recognition

Improving Entity Linking by Modeling Latent Entity Type Information

Entity Linking on Chinese Microblogs Via Deep Neural Network

Deep Entity Linking Via Eliminating Semantic Ambiguity with BERT

An Unsupervised Method for Linking Entity Mentions in Chinese Text.

Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark

Introducing high correlation and high quality instances for few-shot entity linking

Joint Entity Recognition and Disambiguation.

LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty

Named entity recognition for Chinese based on global pointer and adversarial training

SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition

Neural Networks Models for Entity Discovery and Linking.