Abstract:Chinese Named Entity Recognition (NER) is a very important subtask in the information extraction domain. Its purpose is to locate named entities in the text and classify them into predetermined categories. The key point of NER is to learn a high-quality representation of tokens. Recently, representation learning techniques have been introduced into NER due to their excellent performance in mining the semantics of texts and mastering their organization. In the field of Chinese, many studies introduce multimodal feature extraction schemes to enrich token representations, such as radical and word. However, the learning scheme of these auxiliary features is relatively complex and has difficulty learning the interactive relationship between features with a concatenation or MLP fusion method. To address these challenges, a Multimodal Chinese NER Model based on Self-attention Mechanism named MNER is proposed, which consists of a multimodal feature fusion module and an entity classification module. To study the informative characterization of tokens, a multimodal feature fusion module is proposed to exploit radical, character, and word information. In the multimodal feature fusion module, a self-attention mechanism is designed to integrate multimodal features based on the correlation between the features, which addresses the problem that existing methods have difficulty exploiting interaction information between features. A semantic-aware category modifier is proposed to enhance the CRF classification layer's performance. It increases entity discrimination by adjusting the embeddings of features according to the similarity between the token embeddings and embedding of each entity category, which widens the encoding gap between different entities and narrows the search scope for entity classification. Finally, the proposed MNER is compared with ten state-of-the-art methods on Weibo and Resume datasets, and the results show the superiority of our model on three metrics.

Read Extensively, Focus Smartly: A Cross-document Semantic Enhancement Method for Visual Documents NER.

Select & Re-Rank: Effectively and Efficiently Matching Multimodal Data with Dynamically Evolving Attention

Learning with Joint Cross-Document Information Via Multi-Task Learning for Named Entity Recognition

Vision-Enhanced Semantic Entity Recognition in Document Images Via Visually-Asymmetric Consistency Learning

A Local Information Perception Enhancement–Based Method for Chinese NER

Joint Cross-document Information for Named Entity Recognition with Multi-task Learning

Cross-Modal Entity Matching for Visually Rich Documents

Attention Where It Matters: Rethinking Visual Document Understanding with Selective Region Concentration

Exploiting global contextual information for document-level named entity recognition

Hypergraph based Understanding for Document Semantic Entity Recognition

Cross-Modal Entity Resolution for Image and Text Integrating Global and Fine-Grained Joint Attention Mechanism

Semantic enhancement and multi-level alignment network for cross-modal retrieval

Visualizing Multi-Document Semantics Via Open Domain Information Extraction

CAT-MNER: Multimodal Named Entity Recognition with Knowledge-Refined Cross-Modal Attention

EMGE: Entities and Mentions Gradual Enhancement with semantics and connection modeling for document-level relation extraction

Multimodal Class-aware Semantic Enhancement Network for Audio-Visual Video Parsing

Modeling Entities as Semantic Points for Visual Information Extraction in the Wild

Multimodal Pre-Training Based on Graph Attention Network for Document Understanding

Multimodal Features Enhanced Named Entity Recognition Based on Self-Attention Mechanism.

CSMA-CNER:Multi-modal Chinese NER Task with Cross- and Self-Modality Attention

CRISP: A cross-modal integration framework based on the surprisingly popular algorithm for multimodal named entity recognition