Abstract:Named Entity Recognition (NER) on social media refers to discovering and classifying entities from unstructured free-form content, and it plays an important role for various applications such as intention understanding and user recommendation. With social media posts tending to be multimodal, Multimodal Named Entity Recognition (MNER) for the text with its accompanying image is attracting more and more attention since some textual components can only be understood in combination with visual information. However, there are two drawbacks in existing approaches: 1) Meanings of the text and its accompanying image do not match always, so the text information still plays a major role. However, social media posts are usually shorter and more informal compared with other normal contents, which easily causes incomplete semantic description and the data sparsity problem. 2) Although the visual representations of whole images or objects are already used, existing methods ignore either fine-grained semantic correspondence between objects in images and words in text or the objective fact that there are misleading objects or no objects in some images. In this work, we solve the above two problems by introducing the multi-granularity cross-modality representation learning. To resolve the first problem, we enhance the representation by semantic augmentation for each word in text. As for the second issue, we perform the cross-modality semantic interaction between text and vision at the different vision granularity to get the most effective multimodal guidance representation for every word. Experiments show that our proposed approach can achieve the SOTA or approximate SOTA performance on two benchmark datasets of tweets. The code, data and the best performing models are available at https://github.com/LiuPeiP-CS/IIE4MNER

An Approach to Named Entity Recognition Towards Micro-Blog

Exploiting Multiple Embeddings for Chinese Named Entity Recognition

Named Entity Recognition by Using XLNet-BiLSTM-CRF

F-Score Driven Max Margin Neural Network for Named Entity Recognition in Chinese Social Media

A Unified Model for Cross-Domain and Semi-Supervised Named Entity Recognition in Chinese Social Media

Cross-Domain and Semisupervised Named Entity Recognition in Chinese Social Media: A Unified Model.

Automatically Building Large-Scale Named Entity Recognition Corpora from Chinese Wikipedia

Multi-Granularity Cross-Modality Representation Learning for Named Entity Recognition on Social Media

A method for named entity recognition in social media texts with syntactically enhanced multiscale feature fusion

IMPROVING NER IN SOCIAL MEDIA VIA ENTITY TYPE-COMPATIBLE UNKNOWN WORD SUBSTITUTION

Named Entity Recognition in Chinese News Comments on the Web.

Adaptive named entity recognition based on conditional random fields with automatic updated dynamic gazetteers

Named Entity Recognition for Chinese Construction Documents Based on Conditional Random Field

Named entity recognition and emotional viewpoint monitoring in online news using artificial intelligence

Long short-term memory RNN for biomedical named entity recognition

Neural Chinese Named Entity Recognition via CNN-LSTM-CRF and Joint Training with Word Segmentation

New Words Recognition Algorithm and Application Based on Micro-Blog Hot

An Improved Chinese Named Entity Recognition Method with TB-LSTM-CRF

A Toponym Entity Recognition Model for Chinese Social Media

Integrating Language Model and Reading Control Gate in BLSTM-CRF for Biomedical Named Entity Recognition

Adaptive Co-attention Network for Named Entity Recognition in Tweets.