Abstract:The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the emotion flow hidden in dialogue history, facial expressions, audio, and personalities of speakers. Then, they convey suitable emotions according to their personalities, but these multiple types of information are insufficiently exploited in emotional conversation fields. To address this issue, in this paper, we propose a heterogeneous graph-based model for emotional conversation generation. Firstly, we design a Heterogeneous Graph-Based Encoder to represent the conversation content (i.e., the dialogue history, its emotion flow, facial expressions, audio, and speakers' personalities) with a heterogeneous graph neural network, and then predict suitable emotions for feedback. Secondly, we employ an Emotion-Personality-Aware Decoder to generate a response relevant to the conversation context as well as with appropriate emotions, through taking the encoded graph representations, the predicted emotions by the encoder and the personality of the current speaker as inputs. Experiments on both automatic and human evaluation show that our method can effectively perceive emotions from multi-source knowledge and generate a satisfactory response. Furthermore, based on the up-to-date text generator BART, our model still can achieve consistent improvement, which significantly outperforms some existing state-of-the-art models.

Predicting Emotion Reactions for Human–Computer Conversation: A Variational Approach

Learning to Converse Emotionally Like Humans: A Conditional Variational Approach.

Automatically Select Emotion for Response via Personality-affected Emotion Transition

Emotion Analysis for the Upcoming Response in Open-Domain Human-Computer Conversation.

Emotional Dialogue Generation Based on Conditional Variational Autoencoder and Dual Emotion Framework

Chinese Emotional Dialogue Response Generation via Reinforcement Learning

Human-Robot Emotional Interaction Model Based on Reinforcement Learning

Generating Empathetic Responses by Injecting Anticipated Emotion

Exploiting Emotion for Diverse Response Generation in Multi-turn Dialogues

Emotion Prediction in Conversation Based on Relationship Extraction

Survey of Research on End-to-End Emotional Dialogue Generation

Neural Response Generation with Relevant Emotions for Short Text Conversation

Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction

Emotion Eliciting Machine: Emotion Eliciting Conversation Generation based on Dual Generator

Generating Responses with Emotional Scoring

Emotional Human-Machine Conversation Generation Based on Long Short-Term Memory

Neural Conversation Generation with Auxiliary Emotional Supervised Models

Emotional conversation generation with heterogeneous graph neural network

Emotion-Regularized Conditional Variational Autoencoder for Emotional Response Generation

An Emotional Dialogue System Using Conditional Generative Adversarial Networks with a Sequence-to-Sequence Transformer Encoder

What If Bots Feel Moods? Towards Controllable Retrieval-based Dialogue Systems with Emotion-Aware Transition Networks