Abstract:With the rise of social media as a primary channel for information exchange, the spread of online public sentiment has become a key factor in escalating social conflicts and triggering public concern, exerting profound influences on social stability and public values. On some instant interaction platforms, social media texts are often short and noisy, rendering traditional sentiment recognition methods unsuitable for scenarios with scarce short-text content and semantic and emotional uncertainty. To address these challenges, this study proposes a TVE-MGF model (Textual-Visual Context Enhancement and Multi-Granularity Semantic Fusion Model), which utilizes ViLBERT for indepth multimodal feature extraction from both visual context and semantic content. In addition, by enhancing the expression of textual and visual semantics, the model achieves multi-granularity fusion of social media text and associated images, enhancing the precision and comprehensive understanding in sentiment analysis. Furthermore, we adopted feature distillation techniques to optimize the TVE-MGF model, aiming to more effectively extract and utilize implicit knowledge from both visual and textual data to construct higher-level semantic feature representations. This step has bolstered the model’s capacity for generalization and extraction of critical knowledge, significantly improving performance when handling complex multimodal sentiment data. Finally, the methodology was experimentally validated on two multimodal datasets, MVSA-single and MVSA-multiple, with the TVE-MGF model achieving F1 scores of $78.10 \%$ and $79.03 \%$ respectively, thereby demonstrating its effectiveness in enhancing the efficiency of sentiment recognition in social media, particularly for texts with high semantic and emotional uncertainty.

Towards Fine-grained Text Sentiment Transfer

Improving Fine-grained Text Sentiment Transfer for Diverse Review Generation

Fine-Grained Text Sentiment Transfer Via Dependency Parsing

Sentiment Analysis Using Deep Robust Complementary Fusion of Multi-Features and Multi-Modalities.

RAST - A Reward Augmented Model for Fine-Grained Sentiment Transfer.

Fine-Grained Sentiment-Controlled Text Generation Approach Based on Pre-Trained Language Model

Research on Fine-Grained Sentiment Classification.

Image–Text Sentiment Analysis Via Context Guided Adaptive Fine-Tuning Transformer

Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach

Learning To Control The Fine-Grained Sentiment For Story Ending Generation

An Overview on Fine-grained Text Sentiment Analysis: Survey and Challenges

SentiCSE: A Sentiment-aware Contrastive Sentence Embedding Framework with Sentiment-guided Textual Similarity

Refining Word Embeddings Using Intensity Scores for Sentiment Analysis

Multi-modal Feature Fistillation Emotion Recognition Method for Social Media

Fine-Grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesis

Specificity-Driven Cascading Approach for Unsupervised Sentiment Modification

Global Image Sentiment Transfer

Sentiment Analysis on Financial News Headlines using Training Dataset Augmentation

Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classification

CTHFNet: contrastive translation and hierarchical fusion network for text–video–audio sentiment analysis

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.