Abstract:As of present, the progress of conversational AI research has been greatly propelled by large-scale pre-trained language models. In particular, task-oriented dialogue systems have gained widespread attention owing to their immense potential in helping individuals accomplish diverse objectives, such as booking hotels, making restaurant reservations, and purchasing train tickets. In the past, task-oriented dialogue systems were typically viewed as a multi-step process that included spoken language understanding, dialogue state tracking, dialogue policy learning, and natural language generation. More recently, large-scale pre-trained language models enables the development of end-to-end neural pipeline task-oriented dialogue systems, which combine multiple steps into a single model, allowing for joint optimization and preventing error propagation. However, in order to explicitly retrieve information from databases to ensure the interpretability of the system, almost all end-to-end neural pipeline methods inevitably require predicting dialogue state as an intermediate result specialized for the domain or task, which results in significant challenges for generalization. To solve the problem above, we propose O ne- S tep T ask- O riented D ialogue ( OSTOD ) in this paper, which models task-oriented dialogue by synchronously generating activated states and retelling responses, where activated states refer to slot values that contribute to database access, and retelling responses are system responses that contain activated state information. Specifically, first, automatic methods are designed to build data containing activated states and retelling responses. Then, a joint generation model that synchronously predicts activated states and retelling responses in a single step is proposed for task-oriented dialogue modeling. Based on empirical results obtained from the MultiWOZ 2.0 and MultiWOZ 2.1 datasets, our OSTOD model demonstrates comparable performance to state-of-the-art baselines. Moreover, our model exhibits exceptional generalization capabilities in few-shot learning and domain transfer scenarios.

Multi-Step Dialogue Workflow Action Prediction

Improving Generalization in Task-oriented Dialogues with Workflows and Action Plans

Learning through Dialogue Interactions by Asking Questions

Leveraging Explicit Procedural Instructions for Data-Efficient Action Prediction

Dialogue Strategy Adaptation to New Action Sets Using Multi-dimensional Modelling

Towards a Progression-Aware Autonomous Dialogue Agent

Predict-Then-Decide: A Predictive Approach for Wait or Answer Task in Dialogue Systems

Stephanie: Step-by-Step Dialogues for Mimicking Human Interactions in Social Conversations

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Retrieve & Memorize: Dialog Policy Learning with Multi-Action Memory

OSTOD: One-Step Task-Oriented Dialogue with activated state and retelling response

Modeling Long-horizon Tasks as Sequential Interaction Landscapes

Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context

Real-Time Multimodal Turn-taking Prediction to Enhance Cooperative Dialogue during Human-Agent Interaction

Act-Aware Slot-Value Predicting in Multi-Domain Dialogue State Tracking

Multi-task learning with graph attention networks for multi-domain task-oriented dialogue systems

Dialog-to-Actions: Building Task-Oriented Dialogue System via Action-Level Generation

Multi-Domain Dialogue Acts and Response Co-Generation

Non-Autoregressive Dialog State Tracking

Planning Like Human: A Dual-process Framework for Dialogue Planning