Abstract:Retrieval-based dialogue systems are a crucial component of natural language processing, employing information retrieval techniques to select responses from a predefined pool of candidates. The advent of pre-trained language models (PLMs) has significantly advanced the field, with a prevailing paradigm that involves post-training PLMs on specific dialogue corpora, followed by fine-tuning for the response selection (RS) task. This post-training process aims to capture dialogue-specific features, as most PLMs are originally trained on plain text. However, prior approaches predominantly rely on self-supervised tasks or session-level graph neural networks during post-training, focusing on capturing underlying patterns of coherent dialogues without explicitly refining the global pattern across the entire dialogue corpus. Consequently, the learned knowledge for organizing coherent dialogues remains isolated, heavily reliant on specific contexts. Additionally, interpreting or visualizing the implicit knowledge acquired through self-supervised tasks proves challenging. In this study, we address these limitations by explicitly refining the knowledge required for response selection and structuring it into a coherent global flow, known as "dialogue structure." This structure captures the inter-dependency of utterances and topic shifts, thereby enhancing the response selection task. To achieve this, we propose a novel structure model comprising a state recognizer and a structure planner. This model effectively captures the flow within the utterance history and plans the trajectory of future utterances. Importantly, the structure model operates orthogonally to the retrieval model, enabling seamless integration with existing retrieval models and facilitating collaborative training. Extensive experiments conducted on three benchmark datasets demonstrate the superior performance of our method over a wide range of competitive baselines, establishing a new state-of-the-art in the field.

Enhancing Dialog Coherence with Event Graph Grounded Content Planning

Coherent Dialog Generation with Query Graph

Deep Reinforcement Learning for Dialogue Generation

Conversational Graph Grounded Policy Learning for Open-Domain Conversation Generation.

Knowledge Graph Grounded Goal Planning for Open-Domain Conversation Generation

Discovering Dialog Structure Graph for Coherent Dialog Generation

Improving Multi-party Dialogue Generation Via Topic and Rhetorical Coherence

Enhancing Dialogue Generation with Conversational Concept Flows

Dialogues Are Not Just Text: Modeling Cognition for Dialogue Coherence Evaluation

Delving into Global Dialogue Structures: Structure Planning Augmented Response Selection for Multi-turn Conversations.

Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation

Salience-Aware Event Chain Modeling for Narrative Understanding

GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems

Graph-Grounded Goal Planning for Conversational Recommendation

Hierarchical Intention Enhanced Network for Automatic Dialogue Coherence Assessment.

Structured Dialogue Policy with Graph Neural Networks.

Hierarchical Text Generation and Planning for Strategic Dialogue

Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue

AgentGraph: Towards Universal Dialogue Management with Structured Deep Reinforcement Learning

AgentGraph: Toward Universal Dialogue Management with Structured Deep Reinforcement Learning

Coherence Models for Dialogue