Abstract:Task-oriented dialog systems have witnessed substantial progress due to conversational pre-training techniques. Yet, two significant challenges persist. First, most systems primarily utilize the latest turn's state label for the generator. This practice overlooks the comprehensive value of state labels in boosting the model's understanding for future generations. Second, an overreliance on generated policy often leads to error accumulation, resulting in suboptimal responses when adhering to incorrect actions. To combat these challenges, we propose turn-level multi-task objectives for the encoder. With the guidance of essential information from labeled intermediate states, we establish a more robust representation for both understanding and generation. For the decoder, we introduce an action tree-based scheduled sampling technique. Specifically, we model the hierarchical policy as trees and utilize the similarity between trees to sample negative policy based on scheduled sampling, hoping the model to generate invariant responses under perturbations. This method simulates potential pitfalls by sampling similar negative policy, bridging the gap between task-oriented dialog training and inference. Among methods without continual pre-training, our approach achieved state-of-the-art (SOTA) performance on the MultiWOZ dataset series and was also competitive with pre-trained SOTA methods.

Recent Advances and Challenges in Task-Oriented Dialog Systems

Challenges in Building Intelligent Open-domain Dialog Systems

Multi-domain Task-oriented Dialog Challenge II

Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context

Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

Is Your Goal-Oriented Dialog Model Performing Really Well? Empirical Analysis of System-wise Evaluation

Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?

Advances in Multi-turn Dialogue Comprehension: A Survey

Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systems

A review of dialogue systems: current trends and future directions

An Evaluation of Chinese Human-Computer Dialogue Technology

Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges

Let's Negotiate! A Survey of Negotiation Dialogue Systems

Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisations

Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?

A Survey on Dialogue Summarization: Recent Advances and New Frontiers

A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

A Low-Cost, Controllable and Interpretable Task-Oriented Chatbot

TA&AT: Enhancing Task-Oriented Dialog with Turn-Level Auxiliary Tasks and Action-Tree Based Scheduled Sampling

HyKnow: End-to-End Task-Oriented Dialog Modeling with Hybrid Knowledge Management

A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects