Abstract:The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the emotion flow hidden in dialogue history, facial expressions, audio, and personalities of speakers. Then, they convey suitable emotions according to their personalities, but these multiple types of information are insufficiently exploited in emotional conversation fields. To address this issue, in this paper, we propose a heterogeneous graph-based model for emotional conversation generation. Firstly, we design a Heterogeneous Graph-Based Encoder to represent the conversation content (i.e., the dialogue history, its emotion flow, facial expressions, audio, and speakers' personalities) with a heterogeneous graph neural network, and then predict suitable emotions for feedback. Secondly, we employ an Emotion-Personality-Aware Decoder to generate a response relevant to the conversation context as well as with appropriate emotions, through taking the encoded graph representations, the predicted emotions by the encoder and the personality of the current speaker as inputs. Experiments on both automatic and human evaluation show that our method can effectively perceive emotions from multi-source knowledge and generate a satisfactory response. Furthermore, based on the up-to-date text generator BART, our model still can achieve consistent improvement, which significantly outperforms some existing state-of-the-art models.

Exploiting Emotion for Diverse Response Generation in Multi-turn Dialogues

Diversifying Emotional Dialogue Generation via Selective Adversarial Training

An Emotional Dialogue System Using Conditional Generative Adversarial Networks with a Sequence-to-Sequence Transformer Encoder

Emotion-Regularized Conditional Variational Autoencoder for Emotional Response Generation

Generating Responses with a Specific Emotion in Dialog.

Improving the Responses Diversity of Persona-based Neural Conversation System: A Conditional Variational Autoencoders-based Approach

Neural Conversation Generation with Auxiliary Emotional Supervised Models

Chinese Emotional Dialogue Response Generation via Reinforcement Learning

Exploiting Emotion-Semantic Correlations for Empathetic Response Generation

Emotion Eliciting Machine: Emotion Eliciting Conversation Generation based on Dual Generator

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

Emotional conversation generation with heterogeneous graph neural network

CERG: Chinese Emotional Response Generator with Retrieval Method

Topic Enhanced Controllable CVAE for Dialogue Generation (student Abstract).

Apeak-CG: Automatically predicting emotion based dynamic multi-form knowledge fusion conversation generation

Predicting Emotion Reactions for Human–Computer Conversation: A Variational Approach

Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation

Emotional Human-Machine Conversation Generation Based on Long Short-Term Memory

Towards Multimodal Response Generation with Exemplar Augmentation and Curriculum Optimization

Automatically Select Emotion for Response via Personality-affected Emotion Transition

Leveraging hierarchical semantic-emotional memory in emotional conversation generation