Abstract:Controllability and proactivity are crucial properties of autonomous conversational agents (CAs). Controllability requires the CAs to follow the standard operating procedures (SOPs), such as verifying identity before activating credit cards. Proactivity requires the CAs to guide the conversation towards the goal during user uncooperation, such as persuasive dialogue. Existing research cannot be unified with controllability, proactivity, and low manual annotation. To bridge this gap, we propose a new framework for planning-based conversational agents (PCA) powered by large language models (LLMs), which only requires humans to define tasks and goals for the LLMs. Before conversation, LLM plans the core and necessary SOP for dialogue offline. During the conversation, LLM plans the best action path online referring to the SOP, and generates responses to achieve process controllability. Subsequently, we propose a semi-automatic dialogue data creation framework and curate a high-quality dialogue dataset (PCA-D). Meanwhile, we develop multiple variants and evaluation metrics for PCA, e.g., planning with Monte Carlo Tree Search (PCA-M), which searches for the optimal dialogue action while satisfying SOP constraints and achieving the proactive of the dialogue. Experiment results show that LLMs finetuned on PCA-D can significantly improve the performance and generalize to unseen domains. PCA-M outperforms other CoT and ToT baselines in terms of conversation controllability, proactivity, task success rate, and overall logical coherence, and is applicable in industry dialogue scenarios. The dataset and codes are available at XXXX.

Towards a Progression-Aware Autonomous Dialogue Agent

Deep Reinforcement Learning for Dialogue Generation

Learning through Dialogue Interactions by Asking Questions

Planning for Goal-Oriented Dialogue Systems

Generating Dialogue Agents via Automated Planning

Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue

Planning Like Human: A Dual-process Framework for Dialogue Planning

Controllable Conversations: Planning-Based Dialogue Agent with Large Language Models

Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents

Towards End-to-End Learning for Efficient Dialogue Agent by Modeling Looking-ahead Ability

Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner

Rethinking Task-Oriented Dialogue Systems: From Complex Modularity to Zero-Shot Autonomous Agent

Dialogue Strategy Adaptation to New Action Sets Using Multi-dimensional Modelling

DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents

AgentGraph: Towards Universal Dialogue Management with Structured Deep Reinforcement Learning

Improving Proactive Dialog Agents Using Socially-Aware Reinforcement Learning

More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking

Synthetic Dialogue Dataset Generation using LLM Agents

Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot

Planning with Large Language Models for Conversational Agents

AgentGraph: Toward Universal Dialogue Management with Structured Deep Reinforcement Learning