Abstract:Personalization plays a critical role in numerous language tasks and applications, since users with the same requirements may prefer diverse outputs based on their individual interests. This has led to the development of various personalized approaches aimed at adapting large language models (LLMs) to generate customized outputs aligned with user preferences. Some of them involve fine-tuning a unique personalized LLM for each user, which is too expensive for widespread application. Alternative approaches introduce personalization information in a plug-and-play manner by retrieving the user's relevant historical texts as demonstrations. However, this retrieval-based strategy may break the continuity of the user history and fail to capture the user's overall styles and patterns, hence leading to sub-optimal performance. To address these challenges, we propose a novel personalized LLM model, \ours{}. It constructs a user-specific embedding for each individual by modeling all her historical contexts through a lightweight plug-in user embedder module. By attaching this embedding to the task input, LLMs can better understand and capture user habits and preferences, thereby producing more personalized outputs without tuning their own parameters. Extensive experiments on various tasks in the language model personalization (LaMP) benchmark demonstrate that the proposed model significantly outperforms existing personalized LLM approaches.

What problem does this paper attempt to address?

The paper aims to address the limitations of large language models (LLMs) in personalized applications. Specifically, it points out that current LLMs adopt a one-size-fits-all approach, providing similar responses to the same input from different users, thereby neglecting users' personalized needs. Although sampling-based decoding strategies can introduce some diversity, this method still fails to meet individual user preferences, reducing engagement in human-computer interaction. This issue is particularly severe in scenarios where customized responses need to be generated based on users' subjective information. To solve these problems, the researchers proposed a new model called PPlug. This model constructs specific embedding vectors for each user through a lightweight plugin user embedding module, which can capture all historical behavior patterns of the user. By attaching this embedding vector to the task input, LLMs can better understand and capture users' habits and preferences, thereby generating more personalized outputs without adjusting their own parameters. The main contributions of the paper are: 1. Proposing a new personalization framework that guides LLMs in personalized language generation by merely attaching a user-specific embedding. 2. Compared to fine-tuning LLMs for each user individually, PPlug follows a plug-and-play paradigm and does not add extra parameters to LLMs. 3. Compared to retrieval-based LLMs, PPlug can capture users' overall patterns and preferences, achieving better personalization performance. Experimental results show that PPlug significantly outperforms existing personalized LLM methods across multiple tasks, with relative improvements ranging from 1.4% to 35.8%.

LLMs + Persona-Plug = Personalized LLMs

On the Way to LLM Personalization: Learning to Remember User Conversations

Orchestrating LLMs with Different Personalizations

PersonalLLM: Tailoring LLMs to Individual Preferences

AI PERSONA: Towards Life-long Personalization of LLMs

Teach LLMs to Personalize -- An Approach inspired by Writing Education

Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuning

Personalized LLM Response Generation with Parameterized Memory Injection

Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Efforts

Tailoring Personality Traits in Large Language Models via Unsupervisedly-Built Personalized Lexicons

Understanding the Role of User Profile in the Personalization of Large Language Models

Personalized Large Language Models

Personalized LLM for Generating Customized Responses to the Same Query from Different Users

Personalization of Large Language Models: A Survey

Can LLM be a Personalized Judge?

Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices

Integrating Summarization and Retrieval for Enhanced Personalization via Large Language Models

LaMP: When Large Language Models Meet Personalization