Abstract:Task-oriented dialogue (TOD) systems enable users to achieve their goals through natural language interactions. Traditionally, these systems have relied on turn-level manually annotated metadata, such as dialogue states and policy annotations, which are expensive, time-consuming, and often inconsistent or error-prone. This dependence limits the potential to leverage vast amounts of readily available conversational data for training TOD systems. Additionally, a critical challenge in TOD system design is determining when and how to access and integrate information from external sources. Current approaches typically expect this information to be provided alongside the dialogue context, rather than learning to identify and retrieve it autonomously. While pre-trained large language models (LLMs) have been used to develop TOD systems, their potential to train such systems without laborious annotations remains largely unexplored. This work employs multi-task instruction fine-tuning to create more efficient and scalable TOD systems that can effectively leverage natural language conversational data without manual annotations, while autonomously managing external information retrieval. Our extensive experimental evaluations, using three diverse TOD datasets and three LLMs of varying sizes, demonstrate that our approach can generalize to new, unseen domains. Notably, our approach outperforms both state-of-the-art models trained on annotated data and billion-scale parameter off-the-shelf ChatGPT models.

Learning from Relevant Subgoals in Successful Dialogs using Iterative Training for Task-oriented Dialog Systems

Learning through Dialogue Interactions by Asking Questions

Dialogue Learning with Human-in-the-Loop.

Learning to Learn End-to-End Goal-Oriented Dialog From Related Dialog Tasks

Incremental Learning from Scratch for Task-Oriented Dialogue Systems

Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systems

Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems

Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems

A Network-based End-to-End Trainable Task-oriented Dialogue System

TA&AT: Enhancing Task-Oriented Dialog with Turn-Level Auxiliary Tasks and Action-Tree Based Scheduled Sampling

An Asynchronous Updating Reinforcement Learning Framework for Task-oriented Dialog System

Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems

Learning End-to-End Goal-Oriented Dialog with Multiple Answers

Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotations

Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System

Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation

Improving Interaction Quality Estimation with BiLSTMs and the Impact on Dialogue Policy Learning

InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems

Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems

CAUSE: Counterfactual Assessment of User Satisfaction Estimation in Task-Oriented Dialogue Systems

Understanding User Satisfaction with Task-oriented Dialogue Systems