Abstract:Aspect-based sentiment analysis (ABSA), which aims to analyze users' sentiment towards the targeted aspect, has recently gained increasing attention due to its importance in supporting corresponding decision-makings in various tasks. Most existing ABSA studies primarily depend on only textual modality, but ignore the fact that in many cases the targeted aspect doesn't appear in the sentence. Thus, multimodal ABSA is expected to alleviate this dilemma. However, most existing MABSA approaches still suffer from the following limitations: (1) ignoring the possible aspect-image irrelevant issue; (2) ignoring the coarse-grained interaction between the sentence and its associated image; (3) failing to simultaneously leverage multiple types of useful knowledge information. To address these issues, we propose an aspect-guided multi-view interactions and fusion network (AMIFN) for MABSA. Specifically, we utilize the multi-head attention mechanism to generate aspect-guided textual representation, which is used as the extended aspect semantic for guiding the subsequent aspect-related interactions. When exploring aspect-guided visual representation, we employ the image gate to dynamically filter potential noise introduced by the associated image to generate the final image representation. Meanwhile, the coarse-grained sentence-image interaction, which contains context and semantics information, and the syntactic dependencies, are leveraged for graph construction to obtain aspect-guided text-image interaction representations. Finally, the extracted multi-view interaction representations are integrated for sentiment classification. Extensive experimental results on three multimodal benchmark datasets demonstrate the superiority and rationality of AMIFN.

An Interactive Attention Mechanism Fusion Network for Aspect-Based Multimodal Sentiment Analysis

Interactive Fusion Network with Recurrent Attention for Multimodal Aspect-based Sentiment Analysis.

AMIFN: Aspect-guided Multi-view Interactions and Fusion Network for Multimodal Aspect-based Sentiment Analysis

Multi-Grained Fusion Network with Self-Distillation for Aspect-Based Multimodal Sentiment Analysis

Multifeature Interactive Fusion Model for Aspect-Based Sentiment Analysis

ModalNet: an aspect-level sentiment classification model by exploring multimodal data with fusion discriminant attentional network

Dual-Perspective Fusion Network for Aspect-Based Multimodal Sentiment Analysis

A cross-model hierarchical interactive fusion network for end-to-end multimodal aspect-based sentiment analysis

MSFNet: modality smoothing fusion network for multimodal aspect-based sentiment analysis

Self-adaptive attention fusion for multimodal aspect-based sentiment analysis

Hierarchical Fusion Network with Enhanced Knowledge and Contrastive Learning for Multimodal Aspect-Based Sentiment Analysis on Social Media

Prompt Fusion Interaction Transformer for Aspect-Based Multimodal Sentiment Analysis

Graph convolutional network with interactive memory fusion for aspect-based sentiment analysis

Targeted Aspect-Based Multimodal Sentiment Analysis: An Attention Capsule Extraction and Multi-Head Fusion Network

Multilayer interactive attention bottleneck transformer for aspect-based multimodal sentiment analysis

Multi-Interactive Memory Network for Aspect Based Multimodal Sentiment Analysis

MFSC: A Multimodal Aspect-Level Sentiment Classification Framework with Multi-Image Gate and Fusion Networks

BAFN: Bi-Direction Attention Based Fusion Network for Multimodal Sentiment Analysis

Multi-branch Attention Fusion Network for Aspect Sentiment Classification

Multi-level textual-visual alignment and fusion network for multimodal aspect-based sentiment analysis