Abstract:Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is challenging in three aspects: (1) the meaning of a context–response pair is built upon language units from multiple granularities (e.g., words, phrases, and sub-sentences, etc.); (2) local (e.g., a small window around a word) and long-range (e.g., words across the context and the response) dependencies may exist in dialogue data; and (3) the relationship between the context and the response candidate lies in multiple relevant semantic clues or relatively implicit semantic clues in some real cases. However, existing approaches usually encode the dialogue with mono-type representation and the interaction processes between the context and the response candidate are executed in a rather shallow manner, which may lead to an inadequate understanding of dialogue content and hinder the recognition of the semantic relevance between the context and response. To tackle these challenges, we propose a representation [ K ] -interaction [ L ] -matching framework that explores multiple types of deep interactive representations to build context-response matching models for response selection. Particularly, we construct different types of representations for utterance–response pairs and deepen them via alternate encoding and interaction. By this means, the model can handle the relation of neighboring elements, phrasal pattern, and long-range dependencies during the representation and make a more accurate prediction through multiple layers of interactions between the context–response pair. Experiment results on three public benchmarks indicate that the proposed model significantly outperforms previous conventional context-response matching models and achieve slightly better results than the BERT model for multi-turn response selection in retrieval-based dialogue systems.

Learning to Match Representations is Better for End-to-End Task-Oriented Dialog System

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems

A Multi Domain Knowledge Enhanced Matching Network for Response Selection in Retrieval-Based Dialogue Systems

Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog

Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems

Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System

Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues

Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection

Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems

Building an Efficient and Effective Retrieval-based Dialogue System via Mutual Learning

Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues

Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems

Relevance is a Guiding Light: Relevance-aware Adaptive Learning for End-to-end Task-oriented Dialogue System

A Survey on Response Selection for Retrieval-based Dialogues.

CORE: Cooperative Training of Retriever-Reranker for Effective Dialogue Response Selection

Multi-task learning with graph attention networks for multi-domain task-oriented dialogue systems

Reciprocal Learning of Knowledge Retriever and Response Ranker for Knowledge-Grounded Conversations.

Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systems

Learning Multi-turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation