Understanding the performance of AI algorithms in Text-Based Emotion Detection for Conversational Agents

Sheetal D. Kusal,Shruti G. Patil,Jyoti Choudrie,Ketan V. Kotecha

DOI: https://doi.org/10.1145/3643133

IF: 1.471

2024-01-31

ACM Transactions on Asian and Low-Resource Language Information Processing

Abstract:Current industry trends demand automation in every aspect, where machines could replace humans. Recent advancements in conversational agents have grabbed a lot of attention from industries, markets, and businesses. Building conversational agents that exhibit human communication characteristics is a need in today's marketplace. Thus, by accumulating emotions, we can build emotionally-aware conversational agents. Emotion detection in text-based dialogues has turned into a pivotal component of conversational agents, enhancing their ability to understand and respond to users' emotional states. This paper extensively compares various AI - techniques adapted to text-based emotion detection for conversational agents. This study covers a wide range of methods ranging from machine learning models to cutting-edge pre-trained models as well as deep learning models. The authors evaluate the performance of these techniques on the benchmark unbalanced topical chat and empathetic dialogue, balanced datasets. This paper offers an overview of the practical implications of emotion detection techniques in conversational systems and their impact on user response. The outcomes of this paper contribute to the ongoing development of empathetic conversational agents, emphasizing natural human-machine interactions.

computer science, artificial intelligence

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the issue of text emotion detection in dialogue systems, particularly in emotion-aware dialogue agents. Specifically, the authors focus on how to enable dialogue systems to better understand and respond to the emotional states of users.

To address this problem, the authors conducted the following work:

1. **Evaluation and Analysis of Machine Learning Algorithms**: Including Logistic Regression (LR), Multinomial Naive Bayes (MNB), Decision Tree (DT), Support Vector Machine (SVM), and ensemble voting methods. These algorithms were applied to two datasets to classify emotion labels in user dialogues.

2. **Evaluation and Analysis of Deep Learning Techniques**: Including Long Short-Term Memory networks (LSTM), Bidirectional Long Short-Term Memory networks (Bi-LSTM), Gated Recurrent Units (GRU), and Bidirectional Gated Recurrent Units (Bi-GRU). Similarly, these techniques were also applied to two datasets to classify emotion labels in user dialogues.

3. **Evaluation and Analysis of Transformer-based BERT Model**: Used for detecting emotions from dialogues.

4. **Comparative Analysis**: Compared the performance of machine learning, deep learning, and pre-trained models in dialogue emotion detection.

The main contribution of the paper lies in the comprehensive comparison of different methods in handling the task of text emotion detection, with a particular focus on their application in dialogue agents. In this way, the research helps advance the development of emotion-aware dialogue agents, enabling them to interact more naturally with humans. Additionally, the paper discusses previous work in the related field, highlighting the advantages and limitations of existing methods, and proposes future research directions.