From Persona to Personalization: A Survey on Role-Playing Language Agents

Jiangjie Chen,Xintao Wang,Rui Xu,Siyu Yuan,Yikai Zhang,Wei Shi,Jian Xie,Shuang Li,Ruihan Yang,Tinghui Zhu,Aili Chen,Nianqi Li,Lida Chen,Caiyu Hu,Siye Wu,Scott Ren,Ziquan Fu,Yanghua Xiao
2024-10-09
Abstract:Recent advancements in large language models (LLMs) have significantly boosted the rise of Role-Playing Language Agents (RPLAs), i.e., specialized AI systems designed to simulate assigned personas. By harnessing multiple advanced abilities of LLMs, including in-context learning, instruction following, and social intelligence, RPLAs achieve a remarkable sense of human likeness and vivid role-playing performance. RPLAs can mimic a wide range of personas, ranging from historical figures and fictional characters to real-life individuals. Consequently, they have catalyzed numerous AI applications, such as emotional companions, interactive video games, personalized assistants and copilots, and digital clones. In this paper, we conduct a comprehensive survey of this field, illustrating the evolution and recent progress in RPLAs integrating with cutting-edge LLM technologies. We categorize personas into three types: 1) Demographic Persona, which leverages statistical stereotypes; 2) Character Persona, focused on well-established figures; and 3) Individualized Persona, customized through ongoing user interactions for personalized services. We begin by presenting a comprehensive overview of current methodologies for RPLAs, followed by the details for each persona type, covering corresponding data sourcing, agent construction, and evaluation. Afterward, we discuss the fundamental risks, existing limitations, and future prospects of RPLAs. Additionally, we provide a brief review of RPLAs in AI applications, which reflects practical user demands that shape and drive RPLA research. Through this work, we aim to establish a clear taxonomy of RPLA research and applications, and facilitate future research in this critical and ever-evolving field, and pave the way for a future where humans and RPLAs coexist in harmony.
Computation and Language,Artificial Intelligence
What problem does this paper attempt to address?
The problems that this paper attempts to solve are: How to systematically summarize and analyze the research progress of Role - Playing Language Agents (RPLAs), especially their techniques, applications, risks, and future development directions in simulating different types of personas. Specifically: 1. **Persona Classification and Definition**: - **Demographic Persona**: A fictional prototype constructed based on group characteristics (such as occupation, gender, ethnicity, personality type, etc.). - **Character Persona**: An AI system constructed based on existing well - known persons or fictional characters (such as historical figures, celebrities, characters in novels or movies). - **Individualized Persona**: A dynamic personal profile constructed based on the behavior and preference data of a specific individual, aiming to provide personalized services. 2. **Construction Methods of RPLA**: - **Parametric Training**: It includes pre - training, supervised fine - tuning, and reinforcement learning. These methods enhance the role - playing ability of RPLA and the knowledge of specific roles through large - scale text data and dialogue data. - **Nonparametric Prompting**: Directly guide the behavior of RPLA through the prompt information in the context without updating the model parameters. The prompt content includes descriptions and demonstrations to ensure that RPLA can accurately simulate the target persona. 3. **Application Scenarios**: - The application scenarios of RPLA are very extensive, including emotional companionship, interactive games, personalized assistants, digital clones, etc. These applications not only improve the user experience but also promote social science research and technological progress. 4. **Risks and Challenges**: - The paper discusses the risks that RPLA may bring, such as toxic content, bias, hallucination (that is, generating inaccurate or fictional information), privacy invasion, and technical problems in actual deployment. 5. **Future Prospects**: - The paper proposes the directions for future research, emphasizing that while maintaining technological progress, it is necessary to pay attention to ethical and social impacts to ensure that RPLA can coexist harmoniously in human society. Through these contents, the paper aims to provide a clear classification system and a comprehensive review for researchers and practitioners in the RPLA field, and promote the further development of this field.