Abstract:Chinese Named Entity Recognition (NER) is a very important subtask in the information extraction domain. Its purpose is to locate named entities in the text and classify them into predetermined categories. The key point of NER is to learn a high-quality representation of tokens. Recently, representation learning techniques have been introduced into NER due to their excellent performance in mining the semantics of texts and mastering their organization. In the field of Chinese, many studies introduce multimodal feature extraction schemes to enrich token representations, such as radical and word. However, the learning scheme of these auxiliary features is relatively complex and has difficulty learning the interactive relationship between features with a concatenation or MLP fusion method. To address these challenges, a Multimodal Chinese NER Model based on Self-attention Mechanism named MNER is proposed, which consists of a multimodal feature fusion module and an entity classification module. To study the informative characterization of tokens, a multimodal feature fusion module is proposed to exploit radical, character, and word information. In the multimodal feature fusion module, a self-attention mechanism is designed to integrate multimodal features based on the correlation between the features, which addresses the problem that existing methods have difficulty exploiting interaction information between features. A semantic-aware category modifier is proposed to enhance the CRF classification layer's performance. It increases entity discrimination by adjusting the embeddings of features according to the similarity between the token embeddings and embedding of each entity category, which widens the encoding gap between different entities and narrows the search scope for entity classification. Finally, the proposed MNER is compared with ten state-of-the-art methods on Weibo and Resume datasets, and the results show the superiority of our model on three metrics.

Improving Feature Extraction in Named Entity Recognition Based on Maximum Entropy Model

Basic Grammar Rule and Maximum Entropy Based Hybrid Model for Named Entity Recognition

A Local Information Perception Enhancement–Based Method for Chinese NER

Applying rough sets in word segmentation disambiguation based on maximum entropy model

Research on Me-based Chinese NER Model

Comparing Features Combination with Features Fusion in Chinese Named Entity Recognition

Automatic entity relation extraction for the field of tourism

A pragmatic model for new Chinese word extraction

An Improved Maximum Entropy Language Model and Its Application

A Research on the Application of HowNet in Named Entity Recognition

An Improved Feature Representation Method for Maximum Entropy Model.

EMGE: Entities and Mentions Gradual Enhancement with semantics and connection modeling for document-level relation extraction

Modeling Mention, Context and Entity with Neural Networks for Entity Disambiguation.

A neuralized feature engineering method for entity relation extraction

An Entity Relation Extraction Method Based on Dynamic Context and Multi-Feature Fusion

A Novel Chinese Entity Relationship Extraction Method Based on the Bidirectional Maximum Entropy Markov Model

Multimodal Features Enhanced Named Entity Recognition Based on Self-Attention Mechanism.

An Improved Branch Entropy Based Method for Chinese New Words Detection.

Enhancing Chinese Named Entity Recognition with Disentangled Expert Knowledge

IMPROVING NER IN SOCIAL MEDIA VIA ENTITY TYPE-COMPATIBLE UNKNOWN WORD SUBSTITUTION

Automatic and Efficient Recognition of Proper Nouns Based on Maximum Entropy Model