Abstract:End-to-end multi-task dialogue systems are usually designed with separate modules for the dialogue pipeline. Among these, the policy module is essential for deciding what to do in response to user input. This policy is trained by reinforcement learning algorithms by taking advantage of an environment in which an agent receives feedback in the form of a reward signal. The current dialogue systems, however, only provide meagre and simplistic rewards. Investigating intrinsic motivation reinforcement learning algorithms is the goal of this study. Through this, the agent can quickly accelerate training and improve its capacity to judge the quality of its actions by teaching it an internal incentive system. In particular, we adapt techniques for random network distillation and curiosity-driven reinforcement learning to measure the frequency of state visits and encourage exploration by using semantic similarity between utterances. Experimental results on MultiWOZ, a heterogeneous dataset, show that intrinsic motivation-based debate systems outperform policies that depend on extrinsic incentives. By adopting random network distillation, for example, which is trained using semantic similarity between user-system dialogues, an astounding average success rate of 73% is achieved. This is a significant improvement over the baseline Proximal Policy Optimization (PPO), which has an average success rate of 60%. In addition, performance indicators such as booking rates and completion rates show a 10% rise over the baseline. Furthermore, these intrinsic incentive models help improve the system's policy's resilience in an increasing amount of domains. This implies that they could be useful in scaling up to settings that cover a wider range of domains.

Learning Domain-Independent Dialogue Policies Via Ontology Parameterisation.

Replicating Complex Dialogue Policy of Humans Via Offline Imitation Learning with Supervised Regularization.

Dialogue Learning with Human-in-the-Loop.

Policy Learning for Domain Selection in an Extensible Multi-domain Spoken Dialogue System

Cross-domain Dialogue Policy Transfer via Simultaneous Speech-act and Slot Alignment

Dialogue Strategy Adaptation to New Action Sets Using Multi-dimensional Modelling

Guided Dialog Policy Learning: Reward Estimation for Multi-Domain Task-Oriented Dialog

Learning Goal-oriented Dialogue Policy with Opposite Agent Awareness.

Learning Dialogue Policy Efficiently Through Dyna Proximal Policy Optimization.

Prompt Learning for Domain Adaptation in Task-Oriented Dialogue

AgentGraph: Towards Universal Dialogue Management with Structured Deep Reinforcement Learning

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

Few-Shot Structured Policy Learning for Multi-Domain and Multi-Task Dialogues

MTSS: Learn from Multiple Domain Teachers and Become a Multi-domain Dialogue Expert

Scheduled Policy Optimization for Natural Language Communication with Intelligent Agents.

Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policy

Enhancing End-to-End Multi-Task Dialogue Systems: A Study on Intrinsic Motivation Reinforcement Learning Algorithms for Improved Training and Adaptability

Generative Dialog Policy for Task-oriented Dialog Systems

Semi-Supervised Dialogue Policy Learning Via Stochastic Reward Estimation

Anti-Overestimation Dialogue Policy Learning for Task-Completion Dialogue System

Integrating Pretrained Language Model for Dialogue Policy Learning