Abstract:Aspect-level sentiment analysis within multimodal contexts, focusing on the precise identification and interpretation of sentiment attitudes linked to the target aspect across diverse data modalities, remains a focal research area that perpetuates the advancement of discourse and innovation in artificial intelligence. However, most existing methods tend to focus on extracting visual features from only one facet, such as face expression, which ignores the value of information from other key facets, such as the textual information presented by the image modality, resulting in information loss. To overcome the aforementioned constraint, we put forth a novel approach designated as Multi-faceted Information Extraction and Cross-mixture Fusion (MIECF) for Multimodal Aspect-based Sentiment Analysis. Our approach captures more comprehensive visual information in the image and integrates these local and global key features from multiple facets. Local features, such as facial expressions and textual features, provide direct and rich emotional cues. By contrast, the global feature often reflects the overall emotional atmosphere and context. To enhance the visual representation, we designed a Cross-mixture Fusion method to integrate this local and global multimodal information. In particular, the method establishes semantic relationships between local and global features to eliminate ambiguity brought by single-facet information and achieve more accurate contextual understanding, providing a richer and more precise manner for sentiment analysis. The experimental findings indicate that our proposed approach achieves a leading level of performance, resulting in an Accuracy of 79.65 % on the Twitter-2015 dataset, and Macro-F1 scores of 75.90 % and 73.11 % for the Twitter-2015 and Twitter-2017 datasets, respectively.

Document-Level Multi-Aspect Sentiment Classification As Machine Comprehension

Module s 1 , q k s 2 , q k s T , q k Hierarchical

Prior-Bert and Multi-Task Learning for Target-Aspect-Sentiment Joint Detection

Self Question-answering - Aspect-based Sentiment Analysis by Role Flipped Machine Reading Comprehension.

Cascading Multiway Attentions for Document-level Sentiment Classification.

Aspect-level Sentiment Classification Based on Aspect-Oriented Information and Inter-Aspect Relations

Multi-Aspect Sentiment Analysis with Latent Sentiment-Aspect Attribution

Aspect-based Sentiment Analysis as Machine Reading Comprehension.

Aspect-based Sentiment Analysis Model Based on Multi-hop Information

Bidirectional Machine Reading Comprehension for Aspect Sentiment Triplet Extraction.

MIECF: Multi-faceted information extraction and cross-mixture fusion for multimodal aspect-based sentiment analysis

Research on semantic orientation classification of chinese online product reviews based on multi-aspect sentiment analysis

Aspect Sentiment Classification with Document-level Sentiment Preference Modeling

Aspect-specific Sentiment Classification Method Based on High-dimensional Representation

Content Attention Model for Aspect Based Sentiment Analysis

Self-Attention Networks and Adaptive Support Vector Machine for aspect-level sentiment classification

Multi-aspect Sentiment Analysis with Topic Models

Fusion Local and Global Aspect-based Sentiment Analysis

Question-Answering Aspect Classification With Multi-Attention Representation

AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis

Image and Text Aspect Level Multimodal Sentiment Classification Model Using Transformer and Multilayer Attention Interaction