Abstract:Chinese Named Entity Recognition (NER) is a very important subtask in the information extraction domain. Its purpose is to locate named entities in the text and classify them into predetermined categories. The key point of NER is to learn a high-quality representation of tokens. Recently, representation learning techniques have been introduced into NER due to their excellent performance in mining the semantics of texts and mastering their organization. In the field of Chinese, many studies introduce multimodal feature extraction schemes to enrich token representations, such as radical and word. However, the learning scheme of these auxiliary features is relatively complex and has difficulty learning the interactive relationship between features with a concatenation or MLP fusion method. To address these challenges, a Multimodal Chinese NER Model based on Self-attention Mechanism named MNER is proposed, which consists of a multimodal feature fusion module and an entity classification module. To study the informative characterization of tokens, a multimodal feature fusion module is proposed to exploit radical, character, and word information. In the multimodal feature fusion module, a self-attention mechanism is designed to integrate multimodal features based on the correlation between the features, which addresses the problem that existing methods have difficulty exploiting interaction information between features. A semantic-aware category modifier is proposed to enhance the CRF classification layer's performance. It increases entity discrimination by adjusting the embeddings of features according to the similarity between the token embeddings and embedding of each entity category, which widens the encoding gap between different entities and narrows the search scope for entity classification. Finally, the proposed MNER is compared with ten state-of-the-art methods on Weibo and Resume datasets, and the results show the superiority of our model on three metrics.

Enhancing NER with Sentence-Level Entity Detection As an Simple Auxiliary Task

ZH-NER: Chinese Named Entity Recognition with Adversarial Multi-task Learning and Self-Attentions.

Automatically Building Large-Scale Named Entity Recognition Corpora from Chinese Wikipedia

Leveraging Multi-Token Entities in Document-Level Named Entity Recognition.

Multimodal Features Enhanced Named Entity Recognition Based on Self-Attention Mechanism.

A Multi-task Framework for Named Entity Recognition

Dynamic Entity-Based Named Entity Recognition under Unconstrained Tagging Schemes

Pronounce Differently, Mean Differently: A Multi-Tagging-scheme Learning Method for Chinese NER Integrated with Lexicon and Phonetic Features

DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognition

A Multi-task Approach for Machine Reading Comprehension Form Named Entity Recognition Tasks

Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

Toward Recognizing More Entity Types in NER: an Efficient Implementation Using Only Entity Lexicons.

Similarity Based Auxiliary Classifier for Named Entity Recognition

Improving Chinese Named Entity Recognition by Large-Scale Syntactic Dependency Graph

An Improved Method for Chinese Named Entity Recognition Based on MRC

Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach

Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning

Multi-task Transformer with Relation-attention and Type-attention for Named Entity Recognition

A Unified Generative Framework for Various NER Subtasks

Complex Named Entity Recognition via Deep Multi-task Learning from Scratch.

Low-Resource Named Entity Recognition Without Human Annotation