Abstract:With the online presence of more than half the world population, social media plays a very important role in the lives of individuals as well as businesses alike. Social media enables businesses to advertise their products, build brand value, and reach out to their customers. To leverage these social media platforms, it is important for businesses to process customer feedback in the form of posts and tweets. Sentiment analysis is the process of identifying the emotion, either positive, negative or neutral, associated with these social media texts. The presence of sarcasm in texts is the main hindrance in the performance of sentiment analysis. Sarcasm is a linguistic expression often used to communicate the opposite of what is said, usually something that is very unpleasant, with an intention to insult or ridicule. Inherent ambiguity in sarcastic expressions make sarcasm detection very difficult. In this work, we focus on detecting sarcasm in textual conversations from various social networking platforms and online media. To this end, we develop an interpretable deep learning model using multi-head self-attention and gated recurrent units. The multi-head self-attention module aids in identifying crucial sarcastic cue-words from the input, and the recurrent units learn long-range dependencies between these cue-words to better classify the input text. We show the effectiveness of our approach by achieving state-of-the-art results on multiple datasets from social networking platforms and online media. Models trained using our proposed approach are easily interpretable and enable identifying sarcastic cues in the input text which contribute to the final classification score. We visualize the learned attention weights on a few sample input texts to showcase the effectiveness and interpretability of our model.

MMSD-CAF: MultiModal Sarcasm Detection using CoAttention and Fusion Mechanisms

FiLMing Multimodal Sarcasm Detection with Attention

Modelling Visual Semantics via Image Captioning to extract Enhanced Multi-Level Cross-Modal Semantic Incongruity Representation with Attention for Multimodal Sarcasm Detection

Attention-based multi-modal fusion sarcasm detection

Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic

Multi-Modal Sarcasm Detection In Twitter With Hierarchical Fusion Model

Sarcasm driven by sentiment: A sentiment-aware hierarchical fusion network for multimodal sarcasm detection

Multi-Modal Sarcasm Detection with Sentiment Word Embedding

An attention-based, context-aware multimodal fusion method for sarcasm detection using inter-modality inconsistency

Enhanced Semantic Representation Learning for Sarcasm Detection by Integrating Context-Aware Attention and Fusion Network

Multi-View Incongruity Learning for Multimodal Sarcasm Detection

Learning Multi-Task Commonness and Uniqueness for Multi-Modal Sarcasm Detection and Sentiment Analysis in Conversation

Multi-modal sarcasm detection based on emotion perception and cross-modality attention fusion

Dual-level adaptive incongruity-enhanced model for multimodal sarcasm detection

A Semantic Enhancement Framework for Multimodal Sarcasm Detection

MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System

Interpretable Multi-Head Self-Attention Architecture for Sarcasm Detection in Social Media

A smart video analytical framework for sarcasm detection using novel adaptive fusion network and SarcasNet-99 model

A Survey of Multimodal Sarcasm Detection

VyAnG-Net: A Novel Multi-Modal Sarcasm Recognition Model by Uncovering Visual, Acoustic and Glossary Features

Interpretable Multi-Head Self-Attention model for Sarcasm Detection in social media