Abstract:Human emotions are often not expressed directly, but regulated according to internal processes and social display rules. For affective computing systems, an understanding of how users regulate their emotions can be highly useful, for example to provide feedback in job interview training, or in psychotherapeutic scenarios. However, at present no method to automatically classify different emotion regulation strategies in a cross-user scenario exists. At the same time, recent studies showed that instruction-tuned Large Language Models (LLMs) can reach impressive performance across a variety of affect recognition tasks such as categorical emotion recognition or sentiment analysis. While these results are promising, it remains unclear to what extent the representational power of LLMs can be utilized in the more subtle task of classifying users' internal emotion regulation strategy. To close this gap, we make use of the recently introduced \textsc{Deep} corpus for modeling the social display of the emotion shame, where each point in time is annotated with one of seven different emotion regulation classes. We fine-tune Llama2-7B as well as the recently introduced Gemma model using Low-rank Optimization on prompts generated from different sources of information on the \textsc{Deep} corpus. These include verbal and nonverbal behavior, person factors, as well as the results of an in-depth interview after the interaction. Our results show, that a fine-tuned Llama2-7B LLM is able to classify the utilized emotion regulation strategy with high accuracy (0.84) without needing access to data from post-interaction interviews. This represents a significant improvement over previous approaches based on Bayesian Networks and highlights the importance of modeling verbal behavior in emotion regulation.

Large Language Models for Cross-lingual Emotion Detection

TEII: Think, Explain, Interact and Iterate with Large Language Models to Solve Cross-lingual Emotion Detection

Recent Advancement of Emotion Cognition in Large Language Models

Contextual Emotion Recognition using Large Vision Language Models

AER-LLM: Ambiguity-aware Emotion Recognition Leveraging Large Language Models

EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models

Understanding Emotional Body Expressions via Large Language Models

Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations

Modeling Emotions and Ethics with Large Language Models

Customising General Large Language Models for Specialised Emotion Recognition Tasks

YNU-HPCC at WASSA-2023 Shared Task 1: Large-scale Language Model with LoRA Fine-Tuning for Empathy Detection and Emotion Classification

DeepPavlov at SemEval-2024 Task 3: Multimodal Large Language Models in Emotion Reasoning

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal Nuances

Transformer based ensemble for emotion detection

Context and System Fusion in Post-ASR Emotion Recognition with Large Language Models

Large Vision-Language Models as Emotion Recognizers in Context Awareness

The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

Team Phoenix at WASSA 2021: Emotion Analysis on News Stories with Pre-Trained Language Models

E-chat: Emotion-sensitive Spoken Dialogue System with Large Language Models