Abstract:Named Entity Recognition (NER) is the fundamental task for Natural Language Processing (NLP) and the initial step in building a Knowledge Graph (KG). Recently, BERT (Bidirectional Encoder Representations from Transformers), which is a pre-training model, has achieved state-of-the-art (SOTA) results in various NLP tasks, including the NER. However, Chinese NER is still a more challenging task for BERT because there are no physical separations between Chinese words, and BERT can only obtain the representations of Chinese characters. Nevertheless, the Chinese NER cannot be well handled with character-level representations, because the meaning of a Chinese word is quite different from that of the characters, which make up the word. ERNIE (Enhanced Representation through kNowledge IntEgration), which is an improved pre-training model of BERT, is more suitable for Chinese NER because it is designed to learn language representations enhanced by the knowledge masking strategy. However, the potential of ERNIE has not been fully explored. ERNIE only utilizes the token-level features and ignores the sentence-level feature when performing the NER task. In this paper, we propose the ERNIE-Joint, which is a joint model based on ERNIE. The ERNIE-Joint can utilize both the sentence-level and token-level features by joint training the NER and text classification tasks. In order to use the raw NER datasets for joint training and avoid additional annotations, we perform the text classification task according to the number of entities in the sentences. The experiments are conducted on two datasets: MSRA-NER and Weibo. These datasets contain Chinese news data and Chinese social media data, respectively. The results demonstrate that the ERNIE-Joint not only outperforms BERT and ERNIE but also achieves the SOTA results on both datasets.

Based on the Gemini Large-scale Model, Enhanced Accuracy in Semantic Similarity Detection With the Ernie Model

Ernie: Enhanced Language Representation With Informative Entities

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Leveraging Large Language Models for Entity Matching

GNEM: A Generic One-to-Set Neural Entity Matching Framework

ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora

Ercnn: Enhanced Recurrent Convolutional Neural Networks For Learning Sentence Similarity

GEIC: Universal and Multilingual Named Entity Recognition with Large Language Models

LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty

D2LLM: Decomposed and Distilled Large Language Models for Semantic Search

Integration of multi-level semantics in PTMs with an attention model for question matching

An ERNIE-Based Joint Model for Chinese Named Entity Recognition

Enhancing Answer Reliability Through Inter-Model Consensus of Large Language Models

Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion

Enhancing Cloud-Based Large Language Model Processing with Elasticsearch and Transformer Models

Entity Matching using Large Language Models

Tomato, Tomahto, Tomate: Measuring the Role of Shared Semantics among Subwords in Multilingual Language Models

A Model for Geographical Named Entity Recognition and Correction Based on Deep Neural Networks and the BERT Model

Disambiguate Entity Matching using Large Language Models through Relation Discovery

LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition