Abstract:Chinese Named Entity Recognition (NER) is a very important subtask in the information extraction domain. Its purpose is to locate named entities in the text and classify them into predetermined categories. The key point of NER is to learn a high-quality representation of tokens. Recently, representation learning techniques have been introduced into NER due to their excellent performance in mining the semantics of texts and mastering their organization. In the field of Chinese, many studies introduce multimodal feature extraction schemes to enrich token representations, such as radical and word. However, the learning scheme of these auxiliary features is relatively complex and has difficulty learning the interactive relationship between features with a concatenation or MLP fusion method. To address these challenges, a Multimodal Chinese NER Model based on Self-attention Mechanism named MNER is proposed, which consists of a multimodal feature fusion module and an entity classification module. To study the informative characterization of tokens, a multimodal feature fusion module is proposed to exploit radical, character, and word information. In the multimodal feature fusion module, a self-attention mechanism is designed to integrate multimodal features based on the correlation between the features, which addresses the problem that existing methods have difficulty exploiting interaction information between features. A semantic-aware category modifier is proposed to enhance the CRF classification layer's performance. It increases entity discrimination by adjusting the embeddings of features according to the similarity between the token embeddings and embedding of each entity category, which widens the encoding gap between different entities and narrows the search scope for entity classification. Finally, the proposed MNER is compared with ten state-of-the-art methods on Weibo and Resume datasets, and the results show the superiority of our model on three metrics.

Named Entity Recognition of Design Specification Integrated with High-Quality Topic and Attention Mechanism

DABC: A Named Entity Recognition Method Incorporating Attention Mechanisms

Named Entity Recognition for Chinese Construction Documents

A Local Information Perception Enhancement–Based Method for Chinese NER

An Attention-Based Model Using Character Composition of Entities in Chinese Relation Extraction

A Method of Chinese Named Entity Recognition Based on CNN-BILSTM-CRF Model.

Named Entity Recognition in Equipment Support Field Using Tri-Training Algorithm and Text Information Extraction Technology

Named Entity Recognition in Industrial Processes

Integrating deep learning and multi-attention for joint extraction of entities and relationships in engineering consulting texts

Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

Bridge inspection named entity recognition via BERT and lexicon augmented machine reading comprehension neural model

Named entity recognition (NER) for Chinese agricultural diseases and pests based on discourse topic and attention mechanism

Show, Write, and Retrieve: Entity-aware Article Generation and Retrieval

Improving the Named Entity Recognition of Chinese Electronic Medical Records by Combining Domain Dictionary and Rules

A novel feature integration method for named entity recognition model in product titles

A Chinese Named Entity Recognition System with Neural Networks

Multimodal Features Enhanced Named Entity Recognition Based on Self-Attention Mechanism.

KCB-FLAT: Enhancing Chinese Named Entity Recognition with Syntactic Information and Boundary Smoothing Techniques

Named Entity Recognition for Chinese Construction Documents Based on Conditional Random Field

Detecting Entities of Works for Chinese Chatbot

An Attention-Based BiLSTM-CRF Approach to Document-Level Chemical Named Entity Recognition.