Abstract:This paper proposes a Topic-Enhanced Multi-Turn Dialogue Generation Model (TEMDG), which intends to solve the problem of insufficient context as well as topic consistency in the current dialogue models. Firstly, this paper adopts the bi-term topic model (BTM) to extract implicit topics from the corpus, and secondly, in the encoding of historical information, hierarchical recursive coding is used and the computation of word-level attention is introduced into the utterance encoding process. This solves the problem of losing historical information over long distances in hierarchical cyclic coding. The extracted topics are then subjected to the computation of correlation with the history-encoded sentence vectors, aiming to ensure that the resulting topic representation can contain key information related to the dialogue history. Finally, through the fusion attention mechanism, the historical and topic information is fused and decoded in order to generate the corresponding responses. The experimental results show that the TEMDG model outperforms the other baseline models on the DailyDialog dialogue dataset, especially in the diversity metrics showing significant improvement. This indicates that the TEMDG model is able to integrate more information, including topic information and historical dialogue information when generating replies. Sample analyses revealed that the model-generated responses better incorporated topic information, improving the accuracy and relevance of the responses. Based on the results of both automatic and manual evaluation, the TEMDG model is able to consider the topic information and historical dialogue information better when generating replies and generates more natural, smooth, and consistent replies, which effectively solves the problem of lack of consistency of context and topic in the current dialogue model, and significantly improves the quality and consistency of the dialogue generation.

Topic Enhanced Controllable CVAE for Dialogue Generation (student Abstract).

Hagan: Hierarchical Attentive Adversarial Learning For Task-Oriented Dialogue System

Deep Reinforcement Learning for Dialogue Generation

Transformer-Based Conditioned Variational Autoencoder for Dialogue Generation

Context-Controlled Topic-Aware Neural Response Generation for Open-Domain Dialog Systems

Advanced Conditional Variational Autoencoders (A-CVAE): Towards interpreting open-domain conversation generation via disentangling latent feature representation

DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation

Neural Conversation Generation with Auxiliary Emotional Supervised Models

Condition-Transforming Variational Autoencoder for Generating Diverse Short Text Conversations.

Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders

Neural Response Generation with Dynamic Vocabularies

Improving the Responses Diversity of Persona-based Neural Conversation System: A Conditional Variational Autoencoders-based Approach

Goal-oriented conditional variational autoencoders for proactive and knowledge-aware conversational recommender system

A Sentiment-Controllable Topic-to-Essay Generator with Topic Knowledge Graph

An Overview on Controllable Text Generation via Variational Auto-Encoders

Plan-CVAE - A Planning-Based Conditional Variational Autoencoder for Story Generation.

TEMDG: A Multi-Round Dialogue Generation Model Incorporating Topic and Historical Information

DialogWAE: Multimodal Response Generation with Conditional Wasserstein Auto-Encoder

Multi-turn Dialogue Generation Using Self-attention and Nonnegative Matrix Factorization

Cross-Utterance Conditioned VAE for Speech Generation

Topic-word-constrained sentence generation with variational autoencoder