Artificial Empathy Classification: A Survey of Deep Learning Techniques, Datasets, and Evaluation Scales

Sharjeel Tahir,Syed Afaq Shah,Jumana Abu-Khalaf

2023-09-05

Abstract:From the last decade, researchers in the field of machine learning (ML) and assistive developmental robotics (ADR) have taken an interest in artificial empathy (AE) as a possible future paradigm for human-robot interaction (HRI). Humans learn empathy since birth, therefore, it is challenging to instill this sense in robots and intelligent machines. Nevertheless, by training over a vast amount of data and time, imitating empathy, to a certain extent, can be possible for robots. Training techniques for AE, along with findings from the field of empathetic AI research, are ever-evolving. The standard workflow for artificial empathy consists of three stages: 1) Emotion Recognition (ER) using the retrieved features from video or textual data, 2) analyzing the perceived emotion or degree of empathy to choose the best course of action, and 3) carrying out a response action. Recent studies that show AE being used with virtual agents or robots often include Deep Learning (DL) techniques. For instance, models like VGGFace are used to conduct ER. Semi-supervised models like Autoencoders generate the corresponding emotional states and behavioral responses. However, there has not been any study that presents an independent approach for evaluating AE, or the degree to which a reaction was empathetic. This paper aims to investigate and evaluate existing works for measuring and evaluating empathy, as well as the datasets that have been collected and used so far. Our goal is to highlight and facilitate the use of state-of-the-art methods in the area of AE by comparing their performance. This will aid researchers in the area of AE in selecting their approaches with precision.

Robotics,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper primarily explores the current state and progress of research on Artificial Empathy (AE), with a particular focus on methods for achieving and evaluating empathy using deep learning techniques. Specifically, the goals of the paper include:

1. **Reviewing existing deep learning methods**: Technologies used to achieve (detect and evoke) artificial empathy.
2. **Analyzing existing empathy scales**: Comparing the performance of different scales in the field of artificial empathy and discussing their applicability.
3. **Evaluating the effectiveness of datasets**: Examining whether currently available datasets are suitable for training and evaluating artificial empathy models.

The paper also highlights several key findings:
- Most state-of-the-art deep learning-based techniques deal with text data, with recent models such as Transformers showing better performance.
- In visual or multimodal data, methods that fuse different modal features have also achieved good results.
- Reinforcement learning has been used to improve the performance of agents, especially when intrinsic motivation is incorporated into the learning objectives.
- Evaluation metrics are crucial for response generation, but existing language structure-related metrics are not suitable for empathy evaluation, thus necessitating the development of more task-appropriate automatic metrics.

Additionally, the paper proposes a new framework, EPITOME, for modeling empathy from online mental health platforms, and introduces a new dataset. The study also compares the results of human evaluation with automatic evaluation methods, highlighting the challenges in the reliability of automatic metrics.

In summary, this paper aims to provide guidance and support to researchers in the field of artificial empathy by reviewing recent trends, analyzing the effectiveness of evaluation methods and datasets.