Abstract:Social media networks have become a significant aspect of people's lives, serving as a platform for their ideas, opinions and emotions. Consequently, automated sentiment analysis (SA) is critical for recognising people's feelings in ways that other information sources cannot. The analysis of these feelings revealed various applications, including brand evaluations, YouTube film reviews and healthcare applications. As social media continues to develop, people post a massive amount of information in different forms, including text, photos, audio and video. Thus, traditional SA algorithms have become limited, as they do not consider the expressiveness of other modalities. By including such characteristics from various material sources, these multimodal data streams provide new opportunities for optimising the expected results beyond text-based SA. Our study focuses on the forefront field of multimodal SA, which examines visual and textual data posted on social media networks. Many people are more likely to utilise this information to express themselves on these platforms. To serve as a resource for academics in this rapidly growing field, we introduce a comprehensive overview of textual and visual SA, including data pre-processing, feature extraction techniques, sentiment benchmark datasets, and the efficacy of multiple classification methodologies suited to each field. We also provide a brief introduction of the most frequently utilised data fusion strategies and a summary of existing research on visual-textual SA. Finally, we highlight the most significant challenges and investigate several important sentiment applications.

Deriving Emotions and Sentiments from Visual Content: A Disaster Analysis Use Case

Visual Sentiment Analysis from Disaster Images in Social Media

Sentiment Analysis from Images of Natural Disasters

Visual Sentiment Analysis: A Natural DisasterUse-case Task at MediaEval 2021

A Comprehensive Review of Visual-Textual Sentiment Analysis from Social Media Networks

Natural Disasters Detection in Social Media and Satellite imagery: a survey

An Emotion based Sentiment Analysis on Twitter Dataset

Flood of Techniques and Drought of Theories: Emotion Mining in Disasters

Sentiment Analysis: Automatically Detecting Valence, Emotions, and Other Affectual States from Text

Descriptive and visual summaries of disaster events using artificial intelligence techniques: case studies of Hurricanes Harvey, Irma, and Maria

Emotion Detection and Analysis on Social Media

Survey on Visual Sentiment Analysis

Public emotional atmosphere during disasters: understanding emotions in short video comments on the Zhengzhou flood

Explaining sentiment analysis results on social media texts through visualization

Sentiment Extraction from Image-Based Memes Using Natural Language Processing and Machine Learning

Extraction and analysis of natural disaster-related VGI from social media: review, opportunities and challenges

Visual Themes and Sentiment on Social Networks To Aid First Responders During Crisis Events

Multimodal sentimental analysis for social media applications: A comprehensive review

Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages

Deep analytics for workplace risk and disaster management

Application of public emotion feature extraction algorithm based on social media communication in public opinion analysis of natural disasters