Abstract:Conversational systems now attract great attention due to their promising potential and commercial values. To build a conversational system with moderate intelligence is challenging and requires big (conversational) data, as well as interdisciplinary techniques. Thanks to the prosperity of the Web, the massive data available greatly facilitate data-driven methods such as deep learning for human-computer conversational systems. In general, retrieval-based conversational systems apply various matching schema between query utterances and responses, but the classic retrieval paradigm suffers from prominent weakness for conversations: the system finds similar responses given a particular query. For real human-to-human conversations, on the contrary, responses can be greatly different yet all are possibly appropriate. The observation reveals the diversity phenomenon in conversations. In this article, we ascribe the lack of conversational diversity to the reason that the query utterances are statically modeled regardless of candidate responses through traditional methods. To this end, we propose a dynamic representation learning strategy that models the query utterances and different response candidates in an interactive way. To be more specific, we propose a Respond-with-Diversity model augmented by the memory module interacting with both the query utterances and multiple candidate responses. Hence, we obtain dynamic representations for the input queries conditioned on different response candidates. We frame the model as an end-to-end learnable neural network. In the experiments, we demonstrate the effectiveness of the proposed model by achieving a good appropriateness score and much better diversity in retrieval-based conversations between humans and computers.

A NeuRetrieval Model for Human-Computer Conversations

Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System

A Hybrid Retrieval-Generation Neural Conversation Model.

Coupled Context Modeling For Deep Chit-Chat: Towards Conversations Between Human And Computer

An Ensemble of Retrieval-Based and Generation-Based Human-Computer Conversation Systems

"Shall I Be Your Chat Companion?"

Neural Dialogue Model with Retrieval Attention for Personalized Response Generation

A Hybrid Chinese Conversation Model Based on Retrieval and Generation.

Joint Learning of Response Ranking and Next Utterance Suggestion in Human-Computer Conversation System.

Smarter Response with Proactive Suggestion: a New Generative Neural Conversation Paradigm

Joint learning of response ranking and next utterance suggestion in human-computer conversation system

A Survey on Response Selection for Retrieval-based Dialogues.

Multi-Response Awareness for Retrieval-Based Conversations: Respond with Diversity Via Dynamic Representation Learning

Response Selection from Unstructured Documents for Human-Computer Conversation Systems

Two Are Better Than One: an Ensemble of Retrieval- and Generation-Based Dialog Systems.

Deep Human Answer Understanding for Natural Reverse QA

Multi-level Spatio-temporal Matching Network for Multi-turn Response Selection in Retrieval-based Dialogue Systems

UniRetriever: Multi-task Candidates Selection for Various Context-Adaptive Conversational Retrieval

Improving Contextual Language Models for Response Retrieval in Multi-Turn Conversation

Research on Man-Machine Conversation System Based on GRU seq2seq Model

ReBoost: a Retrieval-Boosted Sequence-to-sequence Model for Neural Response Generation