Abstract:Large Language Models (LLMs) has shown exceptional capabilities in many natual language understanding and generation tasks. However, the personalization issue still remains a much-coveted property, especially when it comes to the multiple sources involved in the dialogue system. To better plan and incorporate the use of multiple sources in generating personalized response, we firstly decompose it into three sub-tasks: Knowledge Source Selection, Knowledge Retrieval, and Response Generation. We then propose a novel Unified Multi-Source Retrieval-Augmented Generation system (UniMS-RAG) Specifically, we unify these three sub-tasks with different formulations into the same sequence-to-sequence paradigm during the training, to adaptively retrieve evidences and evaluate the relevance on-demand using special tokens, called acting tokens and evaluation tokens. Enabling language models to generate acting tokens facilitates interaction with various knowledge sources, allowing them to adapt their behavior to diverse task requirements. Meanwhile, evaluation tokens gauge the relevance score between the dialogue context and the retrieved evidence. In addition, we carefully design a self-refinement mechanism to iteratively refine the generated response considering 1) the consistency scores between the generated response and retrieved evidence; and 2) the relevance scores. Experiments on two personalized datasets (DuLeMon and KBP) show that UniMS-RAG achieves state-of-the-art performance on the knowledge source selection and response generation task with itself as a retriever in a unified manner. Extensive analyses and discussions are provided for shedding some new perspectives for personalized dialogue systems.

End-to-End Personalized Humorous Response Generation in Untrimmed Multi-Role Dialogue System.

MIDS: End-to-End Personalized Response Generation in Untrimmed Multi-Role Dialogue.

Generating Personalized Dialogue via Multi-Task Meta-Learning

Multitask Learning and Reinforcement Learning for Personalized Dialog Generation: an Empirical Study.

Investigating deep reinforcement learning techniques in personalized dialogue generation

Personalized Dialogue Response Generation Learned from Monologues

Neural Dialogue Model with Retrieval Attention for Personalized Response Generation

Engaging Live Video Comments Generation

Diverse dialogue generation by fusing mutual persona-aware and self-transferrer

I Know You Better: User Profile Aware Personalized Dialogue Generation

Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation

Know Deeper: Knowledge-Conversation Cyclic Utilization Mechanism for Open-domain Dialogue Generation

Multi-modal multi-hop interaction network for dialogue response generation

Beyond Words: An Intelligent Human-Machine Dialogue System with Multimodal Generation and Emotional Comprehension

UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systems

Personalized Dialogue Generation with Persona-Adaptive Attention

Learning Personalized End-to-End Task-Oriented Dialogue Generation

A Response Generation Framework Based on Empathy Factors, Common Sense, and Persona

A Personalized Dialogue Generator with Implicit User Persona Detection

Integrate the Key Persona Information and Context to Improve the Performance of Multi Round Dialogue Generation

Dialogue History Matters! Personalized Response Selection in Multi-Turn Retrieval-Based Chatbots