Abstract:Intelligent personal assistant systems with either text-based or voice-based conversational interfaces are becoming increasingly popular around the world. Retrieval-based conversation models have the advantages of returning fluent and informative responses. Most existing studies in this area are on open domain "chit-chat" conversations or task / transaction oriented conversations. More research is needed for information-seeking conversations. There is also a lack of modeling external knowledge beyond the dialog utterances among current conversational models. In this paper, we propose a learning framework on the top of deep neural matching networks that leverages external knowledge for response ranking in information-seeking conversation systems. We incorporate external knowledge into deep neural models with pseudo-relevance feedback and QA correspondence knowledge distillation. Extensive experiments with three information-seeking conversation data sets including both open benchmarks and commercial data show that, our methods outperform various baseline methods including several deep text matching models and the state-of-the-art method on response selection in multi-turn conversations. We also perform analysis over different response types, model variations and ranking examples. Our models and research findings provide new insights on how to utilize external knowledge with deep neural models for response selection and have implications for the design of the next generation of information-seeking conversation systems.

Knowledge-incorporating ESIM models for Response Selection in Retrieval-based Dialog Systems

Building Sequential Inference Models for End-to-End Response Selection.

Learning to Select Knowledge for Response Generation in Dialog Systems

A Multi Domain Knowledge Enhanced Matching Network for Response Selection in Retrieval-Based Dialogue Systems

Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems

GKS: Graph-based Knowledge Selector for Task-oriented Dialog System

K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via Prompt Learning

A Survey on Response Selection for Retrieval-based Dialogues.

KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction

Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems

Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversations

Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactions

Knowledge-Retrieval Task-Oriented Dialog Systems with Semi-Supervision

Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs

Learning Multi-turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation

Select, Extend, and Generate: Generative Knowledge Selection for Open-Domain Dialogue Response Generation.

KILDST: Effective Knowledge-Integrated Learning for Dialogue State Tracking using Gazetteer and Speaker Information

Learning to Select External Knowledge with Multi-Scale Negative Sampling

Knowledge Augmented Dialogue Generation with Divergent Facts Selection

Improving knowledge-based dialogue generation through two-stage knowledge selection and knowledge selection-guided pointer network