Abstract:Personality plays a pivotal role in shaping human expression patterns, and empowering and manipulating large language models (LLMs) with personality traits holds significant promise in enhancing the user experience of LLMs. However, prior approaches either rely on fine-tuning LLMs on a corpus enriched with personalized expressions or necessitate the manual crafting of prompts to induce LLMs to produce personalized responses. The former approaches demand substantial time and resources for collecting sufficient training examples while the latter might fail in enabling the precise manipulation of the personality traits at a fine-grained level (e.g., achieving high agreeableness while reducing openness). In this study, we introduce a novel approach for tailoring personality traits within LLMs, allowing for the incorporation of any combination of the Big Five factors (i.e., openness, conscientiousness, extraversion, agreeableness, and neuroticism) in a pluggable manner. This is achieved by employing a set of Unsupervisedly-Built Personalized Lexicons (UBPL) that are utilized to adjust the probability of the next token predicted by the original LLMs during the decoding phase. This adjustment encourages the models to generate words present in the personalized lexicons while preserving the naturalness of the generated texts. Extensive experimentation demonstrates the effectiveness of our approach in finely manipulating LLMs' personality traits. Furthermore, our method can be seamlessly integrated into other LLMs without necessitating updates to their parameters.

Learning to Customize Language Model for Personalized Conversation Systems

Learning to Customize Model Structures for Few-shot Dialogue Generation Tasks

A Persona-Based Neural Conversation Model

Learning from My Friends: Few-Shot Personalized Conversation Systems via Social Networks

Federated Natural Language Generation for Personalized Dialogue System

Learning Personalized End-to-End Goal-Oriented Dialog.

LLMs + Persona-Plug = Personalized LLMs

Personalized Language Modeling from Personalized Human Feedback

Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona

A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Data

Recurrent Neural Network Based Language Model Personalization by Social Network Crowdsourcing

Personalizing universal recurrent neural network language model with user characteristic features by social network crowdsourcing

Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation

Learning to Know Myself: A Coarse-to-Fine Persona-Aware Training Framework for Personalized Dialogue Generation

"In Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learning

Tailoring Personality Traits in Large Language Models via Unsupervisedly-Built Personalized Lexicons

Generating Personalized Dialogue via Multi-Task Meta-Learning

P-Tailor: Customizing Personality Traits for Language Models via Mixture of Specialized LoRA Experts

On the Way to LLM Personalization: Learning to Remember User Conversations

Personalization of Large Language Models: A Survey