Abstract:Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is challenging in three aspects: (1) the meaning of a context–response pair is built upon language units from multiple granularities (e.g., words, phrases, and sub-sentences, etc.); (2) local (e.g., a small window around a word) and long-range (e.g., words across the context and the response) dependencies may exist in dialogue data; and (3) the relationship between the context and the response candidate lies in multiple relevant semantic clues or relatively implicit semantic clues in some real cases. However, existing approaches usually encode the dialogue with mono-type representation and the interaction processes between the context and the response candidate are executed in a rather shallow manner, which may lead to an inadequate understanding of dialogue content and hinder the recognition of the semantic relevance between the context and response. To tackle these challenges, we propose a representation [ K ] -interaction [ L ] -matching framework that explores multiple types of deep interactive representations to build context-response matching models for response selection. Particularly, we construct different types of representations for utterance–response pairs and deepen them via alternate encoding and interaction. By this means, the model can handle the relation of neighboring elements, phrasal pattern, and long-range dependencies during the representation and make a more accurate prediction through multiple layers of interactions between the context–response pair. Experiment results on three public benchmarks indicate that the proposed model significantly outperforms previous conventional context-response matching models and achieve slightly better results than the BERT model for multi-turn response selection in retrieval-based dialogue systems.

Conversational Word Embedding for Retrieval-Based Dialog System

Improve Word Embedding Using Both Writing and Pronunciation.

Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings

RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation

Building an Efficient and Effective Retrieval-based Dialogue System via Mutual Learning

DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation

Word embeddings: A semi-supervised learning method for slot-filling in spoken dialog systems

DLCEncDec : A Fully Character-Level Encoder-Decoder Model for Neural Responding Conversation.

A Bi-Encoder LSTM Model For Learning Unstructured Dialogs

Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues

Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue

Contextualized Query Embeddings for Conversational Search

Deep context modeling for multi-turn response selection in dialogue systems

Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations

Pronunciation-Enhanced Chinese Word Embedding

Enhance word representation for out-of-vocabulary on Ubuntu dialogue corpus

A Survey on Response Selection for Retrieval-based Dialogues.

MEMD: A Diversity-Promoting Learning Framework for Short-Text Conversation.

Human–Machine Multi-Turn Language Dialogue Interaction Based on Deep Learning

Post-encoding and Contrastive Learning Method for Response Selection Task