Abstract:The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the emotion flow hidden in dialogue history, facial expressions, audio, and personalities of speakers. Then, they convey suitable emotions according to their personalities, but these multiple types of information are insufficiently exploited in emotional conversation fields. To address this issue, in this paper, we propose a heterogeneous graph-based model for emotional conversation generation. Firstly, we design a Heterogeneous Graph-Based Encoder to represent the conversation content (i.e., the dialogue history, its emotion flow, facial expressions, audio, and speakers' personalities) with a heterogeneous graph neural network, and then predict suitable emotions for feedback. Secondly, we employ an Emotion-Personality-Aware Decoder to generate a response relevant to the conversation context as well as with appropriate emotions, through taking the encoded graph representations, the predicted emotions by the encoder and the personality of the current speaker as inputs. Experiments on both automatic and human evaluation show that our method can effectively perceive emotions from multi-source knowledge and generate a satisfactory response. Furthermore, based on the up-to-date text generator BART, our model still can achieve consistent improvement, which significantly outperforms some existing state-of-the-art models.

Neural Conversation Generation with Auxiliary Emotional Supervised Models

Neural Response Generation with Relevant Emotions for Short Text Conversation

Emotional Conversation Generation Based on a Bayesian Deep Neural Network

An Emotional Dialogue System Using Conditional Generative Adversarial Networks with a Sequence-to-Sequence Transformer Encoder

Emotional conversation generation with heterogeneous graph neural network

Chinese Emotional Dialogue Response Generation via Reinforcement Learning

Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction

Emotional Conversation Generation Orientated Syntactically Constrained Bidirectional-Asynchronous Framework

Emotional Editing Constraint Conversation Content Generation Based on Reinforcement Learning.

Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation

Emotional Neural Language Generation Grounded in Situational Contexts

A Model of Emotional Speech Generation Based on Conditional Generative Adversarial Networks

Emotion Eliciting Machine: Emotion Eliciting Conversation Generation based on Dual Generator

Diversifying Emotional Dialogue Generation via Selective Adversarial Training

SCBG: Semantic-Constrained Bidirectional Generation for Emotional Support Conversation

Affective Neural Response Generation

CEM: Commonsense-aware Empathetic Response Generation

Emotional Human-Machine Conversation Generation Based on Long Short-Term Memory

EmpCRL: Controllable Empathetic Response Generation via In-Context Commonsense Reasoning and Reinforcement Learning

E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation