Abstract:In real-world scenarios, it is crucial to build a lifelong taskoriented dialogue system (TDS) that continually adapts to new knowledge without forgetting previously acquired experiences. Existing approaches mainly focus on mitigating the catastrophic forgetting in lifelong TDS. However, the transfer ability to generalize the accumulated old knowledge to new tasks is underexplored. In this paper, we propose a two-stage lifelong task-oriented dialogue generation method to mitigate catastrophic forgetting and encourage knowledge transfer simultaneously, inspired by the learning process. In the first stage, we learn task-specific masks which adaptively preserve the knowledge of each visited task so as to mitigate catastrophic forgetting. In this stage, we are expected to learn the task-specific knowledge which is tailored for each task. In the second stage, we bring the knowledge from the encountered tasks together and understand thoroughly. To this end, we devise a balanced meta learning strategy for both forward and backward knowledge transfer in the lifelong learning process. In particular, we perform meta-update with a meta-test set sampled from the current training data for forward knowledge transfer. In addition, we employ an uncertainty-based sampling strategy to select and store representative dialogue samples into episodic memory and perform meta-update with a meta-test set sampled from the memory for backward knowledge transfer. With extensive experiments on 29 tasks, we show that MetaLTDS outperforms the strong baselines in terms of both effectiveness and efficiency. For reproducibility, we submit our code at: https: //github.com/travis-xu/MetaLTDS.

Learning to Learn End-to-End Goal-Oriented Dialog From Related Dialog Tasks

Learning End-to-End Goal-Oriented Dialog with Multiple Answers

Dialogue Learning with Human-in-the-Loop.

Learning through Dialogue Interactions by Asking Questions

Learning End-to-End Goal-Oriented Dialog with Maximal User Task Success and Minimal Human Agent Use

Learning from Relevant Subgoals in Successful Dialogs using Iterative Training for Task-oriented Dialog Systems

Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systems

Towards End-to-End Learning for Efficient Dialogue Agent by Modeling Looking-ahead Ability

Prompt Learning for Domain Adaptation in Task-Oriented Dialogue

Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotations

End-to-End Optimization of Task-Oriented Dialogue Model with Deep Reinforcement Learning

Balanced Meta Learning and Diverse Sampling for Lifelong Task-Oriented Dialogue Systems.

Building Advanced Dialogue Managers for Goal-Oriented Dialogue Systems

Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System

Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System.

Learning to Ground Visual Objects for Visual Dialog

Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking

SUMBT+LaRL: Effective Multi-domain End-to-end Neural Task-oriented Dialog System

Comparing Data Augmentation Methods for End-to-End Task-Oriented Dialog Systems

Effects of Naturalistic Variation in Goal-Oriented Dialog

Learning Personalized End-to-End Goal-Oriented Dialog.