Abstract:Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is challenging in three aspects: (1) the meaning of a context–response pair is built upon language units from multiple granularities (e.g., words, phrases, and sub-sentences, etc.); (2) local (e.g., a small window around a word) and long-range (e.g., words across the context and the response) dependencies may exist in dialogue data; and (3) the relationship between the context and the response candidate lies in multiple relevant semantic clues or relatively implicit semantic clues in some real cases. However, existing approaches usually encode the dialogue with mono-type representation and the interaction processes between the context and the response candidate are executed in a rather shallow manner, which may lead to an inadequate understanding of dialogue content and hinder the recognition of the semantic relevance between the context and response. To tackle these challenges, we propose a representation [ K ] -interaction [ L ] -matching framework that explores multiple types of deep interactive representations to build context-response matching models for response selection. Particularly, we construct different types of representations for utterance–response pairs and deepen them via alternate encoding and interaction. By this means, the model can handle the relation of neighboring elements, phrasal pattern, and long-range dependencies during the representation and make a more accurate prediction through multiple layers of interactions between the context–response pair. Experiment results on three public benchmarks indicate that the proposed model significantly outperforms previous conventional context-response matching models and achieve slightly better results than the BERT model for multi-turn response selection in retrieval-based dialogue systems.

Joint Learning of Response Ranking and Next Utterance Suggestion in Human-Computer Conversation System.

Teaching Machines to Converse

A NeuRetrieval Model for Human-Computer Conversations

Smarter Response with Proactive Suggestion: a New Generative Neural Conversation Paradigm

An Ensemble of Retrieval-Based and Generation-Based Human-Computer Conversation Systems

Joint Learning for Addressee Selection and Response Generation in Multi-Party Conversation

Towards Joint Modeling of Dialogue Response and Speech Synthesis based on Large Language Model

Coupled Context Modeling For Deep Chit-Chat: Towards Conversations Between Human And Computer

Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems

A Hybrid Retrieval-Generation Neural Conversation Model.

Multi-Response Awareness for Retrieval-Based Conversations: Respond with Diversity Via Dynamic Representation Learning

A Survey on Response Selection for Retrieval-based Dialogues.

Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues

Multi-Task Deep Learning for User Intention Understanding in Speech Interaction Systems

An In-depth Investigation of User Response Simulation for Conversational Search.

Emotion Analysis for the Upcoming Response in Open-Domain Human-Computer Conversation.

A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applications

Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction

Multi-turn Response Selection with Commonsense-enhanced Language Models

Personalized Response Generation by Dual-learning Based Domain Adaptation.

Towards Robust Online Dialogue Response Generation