Abstract:Conversational systems now attract great attention due to their promising potential and commercial values. To build a conversational system with moderate intelligence is challenging and requires big (conversational) data, as well as interdisciplinary techniques. Thanks to the prosperity of the Web, the massive data available greatly facilitate data-driven methods such as deep learning for human-computer conversational systems. In general, retrieval-based conversational systems apply various matching schema between query utterances and responses, but the classic retrieval paradigm suffers from prominent weakness for conversations: the system finds similar responses given a particular query. For real human-to-human conversations, on the contrary, responses can be greatly different yet all are possibly appropriate. The observation reveals the diversity phenomenon in conversations. In this article, we ascribe the lack of conversational diversity to the reason that the query utterances are statically modeled regardless of candidate responses through traditional methods. To this end, we propose a dynamic representation learning strategy that models the query utterances and different response candidates in an interactive way. To be more specific, we propose a Respond-with-Diversity model augmented by the memory module interacting with both the query utterances and multiple candidate responses. Hence, we obtain dynamic representations for the input queries conditioned on different response candidates. We frame the model as an end-to-end learnable neural network. In the experiments, we demonstrate the effectiveness of the proposed model by achieving a good appropriateness score and much better diversity in retrieval-based conversations between humans and computers.

Towards a Neural Conversation Model With Diversity Net Using Determinantal Point Processes.

A Simple, Fast Diverse Decoding Algorithm for Neural Generation

Diversifying Neural Conversation Model with Maximal Marginal Relevance.

A Persona-Based Neural Conversation Model

Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints

Promoting Diversity for End-to-End Conversation Response Generation.

Improving the Responses Diversity of Persona-based Neural Conversation System: A Conditional Variational Autoencoders-based Approach

Multi-Response Awareness for Retrieval-Based Conversations: Respond with Diversity Via Dynamic Representation Learning

Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders

HSCJN: A Holistic Semantic Constraint Joint Network for Diverse Response Generation

A Diversity-Promoting Objective Function for Neural Conversation Models

Generating Multiple Diverse Responses for Short-Text Conversation

MEMD: A Diversity-Promoting Learning Framework for Short-Text Conversation.

A Novel Two-Stage Generation Framework for Promoting the Persona-Consistency and Diversity of Responses in Neural Dialog Systems

Generating Diverse Conversation Responses by Creating and Ranking Multiple Candidates

Diversifying Topic-Coherent Response Generation for Natural Multi-turn Conversations

Towards Less Generic Responses in Neural Conversation Models: A Statistical Re-weighting Method

Improving the Diversity of Top-N Recommendation Via Determinantal Point Process.

PVGRU: Generating Diverse and Relevant Dialogue Responses Via Pseudo-Variational Mechanism

DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space

DPP-TTS: Diversifying prosodic features of speech via determinantal point processes