Abstract:Proper response selection is a crucial challenge in retrieval-based chatbots. The state-of-the-art methods match a response with the word sequence of a context, or match the response with each utterance in the context and then accumulate matching information. The former architecture could lose some important local matching information in utterance–response pairs and does not explicitly capture the relationships and dependencies among utterances. The latter architecture does not consider the important global matching information because there is no match between the response and the context at word level. Hence, the above methods have a problem, without considering the fact that matching a response with different levels of a context could match different information for multi-turn response selection. In this work, we propose a hierarchical matching network to match a response with the word and utterance level of a context. At word level, we concatenate the multi-turn context as a long word sequence and then adopt a text matching model to match the response with the word sequence which can capture important matching information at word level. At utterance level, we employ the identical text matching model to match the response with each utterance in the context to capture important matching information for each utterance–response pair and then accumulate the matching information by a recurrent neural network to model the relationships of utterances. At last, the hierarchical matching information is fused to get the final matching information. Experiments on two large-scale public multi-turn response selection datasets show that the proposed model significantly outperforms the state-of-the-art baseline models.

Dialogue Response Selection with Hierarchical Curriculum Learning

Dynamic curriculum learning for conversation response selection

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems

Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems Via Fine-Grained Contrastive Learning

Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection

Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues

Exploring Dense Retrieval for Dialogue Response Selection

Dynamic Curriculum Learning with Co-training for Medical Dialogue Generation

Learning Multi-turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems

Hierarchical matching network for multi-turn response selection in retrieval-based chatbots

Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation

Post-encoding and Contrastive Learning Method for Response Selection Task

Dialogue History Matters! Personalized Response Selection in Multi-Turn Retrieval-Based Chatbots

Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots

Training Neural Response Selection for Task-Oriented Dialogue Systems

A Survey on Response Selection for Retrieval-based Dialogues.

Deep context modeling for multi-turn response selection in dialogue systems

Hierarchical Inductive Transfer for Continual Dialogue Learning

Improving Multi-turn Response Selection Models with Complementary Last-Utterance Selection by Instance Weighting