An Evaluation of State-of-the-Art Large Language Models for Sarcasm Detection

Juliann Zhou
2023-10-07
Abstract:Sarcasm, as defined by Merriam-Webster, is the use of words by someone who means the opposite of what he is trying to say. In the field of sentimental analysis of Natural Language Processing, the ability to correctly identify sarcasm is necessary for understanding people's true opinions. Because the use of sarcasm is often context-based, previous research has used language representation models, such as Support Vector Machine (SVM) and Long Short-Term Memory (LSTM), to identify sarcasm with contextual-based information. Recent innovations in NLP have provided more possibilities for detecting sarcasm. In BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, Jacob Devlin et al. (2018) introduced a new language representation model and demonstrated higher precision in interpreting contextualized language. As proposed by Hazarika et al. (2018), CASCADE is a context-driven model that produces good results for detecting sarcasm. This study analyzes a Reddit corpus using these two state-of-the-art models and evaluates their performance against baseline models to find the ideal approach to sarcasm detection.
Computation and Language,Artificial Intelligence
What problem does this paper attempt to address?
The paper aims to address the issue of sarcasm detection in the field of Natural Language Processing (NLP). Specifically, the paper evaluates the performance of two state-of-the-art models—CASCADE and RCNN-RoBERTa—on the Reddit dataset to assess their effectiveness in the task of sarcasm recognition. The core objective of the study is to validate the effectiveness of context-based methods (such as CASCADE) versus deep learning-based methods (such as RCNN-RoBERTa) in sarcasm detection tasks and to explore the potential of combining these two approaches. Through this comparative analysis, the paper hopes to identify the ideal method better suited for sarcasm detection.