Abstract:Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is challenging in three aspects: (1) the meaning of a context–response pair is built upon language units from multiple granularities (e.g., words, phrases, and sub-sentences, etc.); (2) local (e.g., a small window around a word) and long-range (e.g., words across the context and the response) dependencies may exist in dialogue data; and (3) the relationship between the context and the response candidate lies in multiple relevant semantic clues or relatively implicit semantic clues in some real cases. However, existing approaches usually encode the dialogue with mono-type representation and the interaction processes between the context and the response candidate are executed in a rather shallow manner, which may lead to an inadequate understanding of dialogue content and hinder the recognition of the semantic relevance between the context and response. To tackle these challenges, we propose a representation [ K ] -interaction [ L ] -matching framework that explores multiple types of deep interactive representations to build context-response matching models for response selection. Particularly, we construct different types of representations for utterance–response pairs and deepen them via alternate encoding and interaction. By this means, the model can handle the relation of neighboring elements, phrasal pattern, and long-range dependencies during the representation and make a more accurate prediction through multiple layers of interactions between the context–response pair. Experiment results on three public benchmarks indicate that the proposed model significantly outperforms previous conventional context-response matching models and achieve slightly better results than the BERT model for multi-turn response selection in retrieval-based dialogue systems.

Deep Contextualized Utterance Representations for Response Selection and Dialogue Analysis

Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems

The SPPD System for Schema Guided Dialogue State Tracking Challenge

WeChat AI & ICT's Submission for DSTC9 Interactive Dialogue Evaluation Track

Multi-domain Task-oriented Dialog Challenge II

Hierarchical Context Enhanced Multi-Domain Dialogue System for Multi-domain Task Completion

Dialog system technology challenge 7

Overview of the Eighth Dialog System Technology Challenge: DSTC8

Deep context modeling for multi-turn response selection in dialogue systems

Enhanced Multi-Domain Dialogue State Tracker with Second-Order Slot Interactions

The SJTU System for Dialog State Tracking Challenge 2

Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Tracking

Promoting Diversity for End-to-End Conversation Response Generation.

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

Building Sequential Inference Models for End-to-End Response Selection.

DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning

Hybrid Dialogue State Tracking for Real World Human-to-Human Dialogues

Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues

Generating Diverse Conversation Responses by Creating and Ranking Multiple Candidates

Overview of the Tenth Dialog System Technology Challenge: DSTC10

Benchmarks Underestimate the Readiness of Multi-lingual Dialogue Agents