Abstract:Retrieval-based dialogue systems are a crucial component of natural language processing, employing information retrieval techniques to select responses from a predefined pool of candidates. The advent of pre-trained language models (PLMs) has significantly advanced the field, with a prevailing paradigm that involves post-training PLMs on specific dialogue corpora, followed by fine-tuning for the response selection (RS) task. This post-training process aims to capture dialogue-specific features, as most PLMs are originally trained on plain text. However, prior approaches predominantly rely on self-supervised tasks or session-level graph neural networks during post-training, focusing on capturing underlying patterns of coherent dialogues without explicitly refining the global pattern across the entire dialogue corpus. Consequently, the learned knowledge for organizing coherent dialogues remains isolated, heavily reliant on specific contexts. Additionally, interpreting or visualizing the implicit knowledge acquired through self-supervised tasks proves challenging. In this study, we address these limitations by explicitly refining the knowledge required for response selection and structuring it into a coherent global flow, known as "dialogue structure." This structure captures the inter-dependency of utterances and topic shifts, thereby enhancing the response selection task. To achieve this, we propose a novel structure model comprising a state recognizer and a structure planner. This model effectively captures the flow within the utterance history and plans the trajectory of future utterances. Importantly, the structure model operates orthogonally to the retrieval model, enabling seamless integration with existing retrieval models and facilitating collaborative training. Extensive experiments conducted on three benchmark datasets demonstrate the superior performance of our method over a wide range of competitive baselines, establishing a new state-of-the-art in the field.

Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure

A Joint Model of Conversational Discourse and Latent Topics on Microblogs

Generating Dialogue Responses with Latent Lexical Meaning

What You Say and How You Say it: Joint Modeling of Topics and Discourse in Microblog Conversations

Learning The Structures Of Online Asynchronous Conversations

Hierarchical Latent Variables Structure for Topic Aware Multi-Turn Conversation

Use of explicit replies as coordination mechanisms in online student debate

Who did They Respond to? Conversation Structure Modeling using Masked Hierarchical Transformer

Modeling Dynamic Multi-Topic Discussions in Online Forums.

Delving into Global Dialogue Structures: Structure Planning Augmented Response Selection for Multi-turn Conversations.

With a Little Help from my (Linguistic) Friends: Topic Segmentation of Multi-party Casual Conversations

Modeling Influence in Online Multi-party Discourse

Modeling Online Discourse with Coupled Distributed Topics

Linguistic Properties Matter for Implicit Discourse Relation Recognition: Combining Semantic Interaction, Topic Continuity and Attribution

Unsupervised Mutual Learning of Dialogue Discourse Parsing and Topic Segmentation

Who is Answering Whom? Finding "Reply-To" Relations in Group Chats with Deep Bidirectional LSTM Networks

Joint Modeling of Recognizing Macro Chinese Discourse Nuclearity and Relation Based on Structure and Topic Gated Semantic Network.

Topic Aware Context Modelling For Dialogue Response Generation

Who Is Answering to Whom? Finding “Reply-To” Relations in Group Chats with Long Short-Term Memory Networks

Group Dynamics in Discussing Incidental Topics over Online Social Networks

Joint Learning of Response Ranking and Next Utterance Suggestion in Human-Computer Conversation System.