SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations

Fanfan Wang,Heqing Ma,Jianfei Yu,Rui Xia,Erik Cambria
2024-07-08
Abstract:The ability to understand emotions is an essential component of human-like artificial intelligence, as emotions greatly influence human cognition, decision making, and social interactions. In addition to emotion recognition in conversations, the task of identifying the potential causes behind an individual's emotional state in conversations, is of great importance in many application scenarios. We organize SemEval-2024 Task 3, named Multimodal Emotion Cause Analysis in Conversations, which aims at extracting all pairs of emotions and their corresponding causes from conversations. Under different modality settings, it consists of two subtasks: Textual Emotion-Cause Pair Extraction in Conversations (TECPE) and Multimodal Emotion-Cause Pair Extraction in Conversations (MECPE). The shared task has attracted 143 registrations and 216 successful submissions. In this paper, we introduce the task, dataset and evaluation settings, summarize the systems of the top teams, and discuss the findings of the participants.
Computation and Language,Artificial Intelligence,Multimedia
What problem does this paper attempt to address?
The paper attempts to address the problem of Multimodal Emotion Cause Analysis in Conversations. Specifically, the goal of the research is to extract all potential emotions and their corresponding cause pairs from a given conversation. This task is divided into two subtasks: 1. **Textual Emotion-Cause Pair Extraction (TECPE)**: Extracting all emotion-cause pairs from the conversation based solely on text, where each pair contains an expression with an emotion category and a textual cause span. 2. **Multimodal Emotion-Cause Pair Extraction (MECPE)**: Considering three modalities—language, audio, and visual—to extract all emotion-cause pairs at the conversation level. By organizing this task, the researchers aim to promote the progress of emotion cause analysis in conversations and apply it to practical scenarios such as human-computer interaction, business customer service, empathetic chatbots, and automated psychotherapy. Additionally, the paper details the dataset construction, evaluation metrics, and performance comparison of the participating systems.