Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona

Yihong Tang,Bo Wang,Miao Fang,Dongming Zhao,Kun Huang,Ruifang He,Yuexian Hou

2023-05-19

Abstract:The personalized dialogue explores the consistent relationship between dialogue generation and personality. Existing personalized dialogue agents model persona profiles from three resources: sparse or dense persona descriptions and dialogue histories. However, sparse structured persona attributes are explicit but uninformative, dense persona texts contain rich persona descriptions with much noise, and dialogue history query is both noisy and uninformative for persona modeling. In this work, we combine the advantages of the three resources to obtain a richer and more accurate persona. We design a Contrastive Latent Variable-based model (CLV) that clusters the dense persona descriptions into sparse categories, which are combined with the history query to generate personalized responses. Experimental results on Chinese and English datasets demonstrate our model's superiority in personalization.

Computation and Language

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address issues in personalized dialogue generation. Specifically, it attempts to combine the advantages of three resources (sparse attributes, dense descriptive texts, and dialogue history) to improve the quality of personalized dialogues. Existing personalized dialogue agents typically model character traits from three resources:

1. **Sparse Character Attributes**: Such as gender, age, etc. This type of information is easy to interpret but limited in information content, unable to express complex character traits.
2. **Dense Character Descriptive Texts**: Contain rich descriptive information about characters but have noise.
3. **Dialogue History Queries**: Do not require additional character information, but due to noise and irrelevant information in historical queries, it is challenging to model character traits directly from dialogue history.

To address these issues, the paper proposes a method based on Contrastive Latent Variables (CLV), which clusters dense character descriptive texts into sparse categories and combines historical queries to generate personalized responses. Experimental results show that the model demonstrates superior personalization capabilities on both Chinese and English datasets.