Abstract:Chinese Named Entity Recognition (NER) is a very important subtask in the information extraction domain. Its purpose is to locate named entities in the text and classify them into predetermined categories. The key point of NER is to learn a high-quality representation of tokens. Recently, representation learning techniques have been introduced into NER due to their excellent performance in mining the semantics of texts and mastering their organization. In the field of Chinese, many studies introduce multimodal feature extraction schemes to enrich token representations, such as radical and word. However, the learning scheme of these auxiliary features is relatively complex and has difficulty learning the interactive relationship between features with a concatenation or MLP fusion method. To address these challenges, a Multimodal Chinese NER Model based on Self-attention Mechanism named MNER is proposed, which consists of a multimodal feature fusion module and an entity classification module. To study the informative characterization of tokens, a multimodal feature fusion module is proposed to exploit radical, character, and word information. In the multimodal feature fusion module, a self-attention mechanism is designed to integrate multimodal features based on the correlation between the features, which addresses the problem that existing methods have difficulty exploiting interaction information between features. A semantic-aware category modifier is proposed to enhance the CRF classification layer's performance. It increases entity discrimination by adjusting the embeddings of features according to the similarity between the token embeddings and embedding of each entity category, which widens the encoding gap between different entities and narrows the search scope for entity classification. Finally, the proposed MNER is compared with ten state-of-the-art methods on Weibo and Resume datasets, and the results show the superiority of our model on three metrics.

Chinese Named Entity Recognition Method Based on Multi-head Attention Enhancing Word Information

A Local Information Perception Enhancement–Based Method for Chinese NER

CWAI-CNER: Chinese entity recognition based on adaptive incorporation of characters and words

Exploiting Character-Word Fusion to Enhance Chinese Named Entity Recognition Combined with Multi-head Attention Mechanism

Chinese Named Entity Recognition with Character-Level BLSTM and Soft Attention Model

Joint Self-Attention and Multi-Embeddings for Chinese Named Entity Recognition

Named Entity Recognition Based on Pre-training Model and Multi-head Attention Mechanism

CAN-NER: Convolutional Attention Network for Chinese Named Entity Recognition

DBM-CNER: A Dual-Branch Multifeature Model for Chinese Named Entity Recognition.

CSMA-CNER:Multi-modal Chinese NER Task with Cross- and Self-Modality Attention

ZH-NER: Chinese Named Entity Recognition with Adversarial Multi-task Learning and Self-Attentions.

Chinese Named-Entity Recognition Via Self-Attention Mechanism and Position-Aware Influence Propagation Embedding

Attention-Based Bi-LSTM for Chinese Named Entity Recognition.

A Chinese named entity recognition model: integrating label knowledge and lexicon information

Pretraining Multi-modal Representations for Chinese NER Task with Cross-Modality Attention

Chinese Clinical Named Entity Recognition Via Multi-Head Self-Attention Based BiLSTM-CRF

Chinese Named Entity Recognition with Character-Word Mixed Embedding.

LACNNER: Lexicon-Aware Character Representation for Chinese Nested Named Entity Recognition.

Multimodal Features Enhanced Named Entity Recognition Based on Self-Attention Mechanism.

Chinese named entity recognition: The state of the art

A Novel Character-Word Fusion Chinese Named Entity Recognition Model Based on Attention Mechanism