Abstract:Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is challenging in three aspects: (1) the meaning of a context–response pair is built upon language units from multiple granularities (e.g., words, phrases, and sub-sentences, etc.); (2) local (e.g., a small window around a word) and long-range (e.g., words across the context and the response) dependencies may exist in dialogue data; and (3) the relationship between the context and the response candidate lies in multiple relevant semantic clues or relatively implicit semantic clues in some real cases. However, existing approaches usually encode the dialogue with mono-type representation and the interaction processes between the context and the response candidate are executed in a rather shallow manner, which may lead to an inadequate understanding of dialogue content and hinder the recognition of the semantic relevance between the context and response. To tackle these challenges, we propose a representation [ K ] -interaction [ L ] -matching framework that explores multiple types of deep interactive representations to build context-response matching models for response selection. Particularly, we construct different types of representations for utterance–response pairs and deepen them via alternate encoding and interaction. By this means, the model can handle the relation of neighboring elements, phrasal pattern, and long-range dependencies during the representation and make a more accurate prediction through multiple layers of interactions between the context–response pair. Experiment results on three public benchmarks indicate that the proposed model significantly outperforms previous conventional context-response matching models and achieve slightly better results than the BERT model for multi-turn response selection in retrieval-based dialogue systems.

Local and Global Context Modeling with Relation Matching Task for Dialog Act Recognition

Dialogue Act Recognition Via CRF-Attentive Structured Network

Local Contextual Attention with Hierarchical Structure for Dialogue Act Recognition

DARER: Dual-task Temporal Relational Recurrent Reasoning Network for Joint Dialog Sentiment Classification and Act Recognition

Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understanding

Local and Global Contexts for Conversation

A Bi-directional Multi-hop Inference Model for Joint Dialog Sentiment Classification and Act Recognition

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems

DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification.

Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues

Improving Contextual Language Models for Response Retrieval in Multi-Turn Conversation

FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning

Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension

Chinese Dialogue Analysis Using Multi-Task Learning Framework

Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues

How to Represent Context Better? an Empirical Study on Context Modeling for Multi-turn Response Selection.

Context Directed Speech Recognition in Dialogue Systems

Deep context modeling for multi-turn response selection in dialogue systems

A Context-based Approach for Dialogue Act Recognition using Simple Recurrent Neural Networks

GAL: combining global and local contexts for interpersonal relation extraction toward document-level Chinese text

Dialogue emotion model based on local–global context encoder and commonsense knowledge fusion attention