Abstract:Personalized dialogue generation, focusing on generating highly tailored responses by leveraging persona profiles and dialogue context, has gained significant attention in conversational AI applications. However, persona profiles, a prevalent setting in current personalized dialogue datasets, typically composed of merely four to five sentences, may not offer comprehensive descriptions of the persona about the agent, posing a challenge to generate truly personalized dialogues. To handle this problem, we propose $\textbf{L}$earning Retrieval $\textbf{A}$ugmentation for $\textbf{P}$ersonalized $\textbf{D}$ial$\textbf{O}$gue $\textbf{G}$eneration ($\textbf{LAPDOG}$), which studies the potential of leveraging external knowledge for persona dialogue generation. Specifically, the proposed LAPDOG model consists of a story retriever and a dialogue generator. The story retriever uses a given persona profile as queries to retrieve relevant information from the story document, which serves as a supplementary context to augment the persona profile. The dialogue generator utilizes both the dialogue history and the augmented persona profile to generate personalized responses. For optimization, we adopt a joint training framework that collaboratively learns the story retriever and dialogue generator, where the story retriever is optimized towards desired ultimate metrics (e.g., BLEU) to retrieve content for the dialogue generator to generate personalized responses. Experiments conducted on the CONVAI2 dataset with ROCStory as a supplementary data source show that the proposed LAPDOG method substantially outperforms the baselines, indicating the effectiveness of the proposed method. The LAPDOG model code is publicly available for further exploration. <a class="link-external link-https" href="https://github.com/hqsiswiliam/LAPDOG" rel="external noopener nofollow">this https URL</a>

What problem does this paper attempt to address?

### The Problem Addressed by the Paper The paper primarily focuses on an issue in Personalized Dialogue Generation: the persona profiles in existing personalized dialogue datasets typically consist of 4 to 5 sentences. Such brief descriptions are insufficient to comprehensively reflect the characteristics of the personas, leading to generated dialogues that lack personalization. To address this issue, the authors propose a method called **Learning Retrieval Augmentation for Personalized DialOgue Generation (LAPDOG)**. Specifically, LAPDOG consists of two components: 1. **Story Retriever**: Retrieves relevant information from an external story dataset based on the given persona description. 2. **Dialogue Generator**: Generates more personalized responses by combining dialogue history with the augmented persona description. Through this approach, LAPDOG can enrich persona descriptions by acquiring additional information from external data sources, thereby better reflecting the persona's individuality during the generation process. Experimental results show that the LAPDOG method significantly outperforms baseline methods on the CONV AI2 dataset, demonstrating its effectiveness and potential.

Learning Retrieval Augmentation for Personalized Dialogue Generation

Doing Personal LAPS: LLM-Augmented Dialogue Construction for Personalized Multi-Session Conversational Search

Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularization

Multitask Learning and Reinforcement Learning for Personalized Dialog Generation: an Empirical Study.

Data Augmentation for Retrieval- and Generation-Based Dialog Systems

Learning Towards Selective Data Augmentation for Dialogue Generation.

Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System

Personalized Dialogue Generation with Persona-Adaptive Attention

Personalized Dialogue Response Generation Learned from Monologues

Dialogue History Matters! Personalized Response Selection in Multi-Turn Retrieval-Based Chatbots

A Personalized Dialogue Generator with Implicit User Persona Detection

Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots

Diverse dialogue generation by fusing mutual persona-aware and self-transferrer

PAL: Persona-Augmented Emotional Support Conversation Generation

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

From easy to hard: Improving personalized response generation of task-oriented dialogue systems by leveraging capacity in open-domain dialogues

Learning to Know Myself: A Coarse-to-Fine Persona-Aware Training Framework for Personalized Dialogue Generation

"In Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learning

Learning Personalized End-to-End Goal-Oriented Dialog.

Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona

Investigating deep reinforcement learning techniques in personalized dialogue generation