Abstract:Incorporating topic information can help response generation models to produce informative responses for chat-bots. Previous work only considers the individual semantic of each topic, ignoring its specific dialog context, which may result in inaccurate topic representation and hurt response coherence. Besides, as an important feature of multi-turn conversation, dynamic topic transitions have not been well-studied. We propose a Context-Controlled Topic-Aware neural response generation model, i.e., CCTA, which makes dialog context interact with the process of topic representing and transiting to achieve balanced improvements on response informativeness and contextual coherence. CCTA focuses on capturing the semantical relations within topics as well as their corresponding contextual information in conversation, to produce context-dependent topic representations at the word-level and turn-level. Besides, CCTA introduces a context-controlled topic transition strategy, utilizing contextual topics to yield relevant transition words. Extensive experimental results on two benchmark multi-turn conversation datasets validate the superiority of our proposal on generating coherent and informative responses against the state-of-the-art baselines. We also find that topic transition modeling can work as an auxiliary learning task to boost the response generation.

Hierarchical Latent Variables Structure for Topic Aware Multi-Turn Conversation

Hagan: Hierarchical Attentive Adversarial Learning For Task-Oriented Dialogue System

A Hierarchical Latent Structure for Variational Conversation Modeling

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints

A Latent-Constrained Variational Neural Dialogue Model for Information-Rich Responses

A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues

Multi-task Learning for Multi-turn Dialogue Generation with Topic Drift Modeling

Learning Topic Hierarchies by Tree-Directed Latent Variable Models

Dirichlet Latent Variable Hierarchical Recurrent Encoder-Decoder in Dialogue Generation.

Topic-Aware Multi-turn Dialogue Modeling

Extending the Transformer with Context and Multi-dimensional Mechanism for Dialogue Response Generation.

Interactive Topic Modeling Based on Hierarchical Dirichlet Process

Long and Diverse Text Generation with Planning-based Hierarchical Variational Model

Hierarchical Generative Modeling for Controllable Speech Synthesis

Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure

Context-Controlled Topic-Aware Neural Response Generation for Open-Domain Dialog Systems

On the Affinity, Rationality, and Diversity of Hierarchical Topic Modeling

Topic Enhanced Controllable CVAE for Dialogue Generation (student Abstract).

Sequential Topic Selection Model with Latent Variable for Topic-Grounded Dialogue

HKA: A Hierarchical Knowledge Attention Mechanism for Multi-Turn Dialogue System