Abstract:The evolution of Large Language Models (LLMs) has introduced a new paradigm for investigating human behavior emulation. Recent research has employed LLM-based Agents to create a sociological research environment, in which agents exhibit behavior based on the unfiltered characteristics of large language models. However, these studies overlook the iterative development within a human-like setting - Human preferences and personalities are complex, shaped by various factors and subject to ongoing change as a result of environmental and subjective influences. In light of this observation, we propose Agent Framework for Shaping Preference and Personality (AFSPP), exploring the multifaceted impact of social networks and subjective consciousness on LLM-based Agents' preference and personality formation. With AFSPP, we have, for the first time, successfully replicated several key findings from human personality experiments. And other AFSPP-based experimental results indicate that plan making, sensory perceptions and social networking with subjective information, wield the most pronounced influence on preference shaping. AFSPP can significantly enhance the efficiency and scope of psychological experiments, while yielding valuable insights for Trustworthy Artificial Intelligence research for strategies to prevent undesirable preference and personality development.

What problem does this paper attempt to address?

The problems this paper attempts to address are: 1. **How to shape the preferences and personalities of agents based on large language models (LLMs) through social networks and subjective awareness**: Existing research, while utilizing LLMs to create social research environments that simulate human behavior, often overlooks the evolving process of human preferences and personalities in complex and dynamic social environments. Human preferences and personalities are influenced by multiple factors and change over time, environment, and personal experiences. 2. **How to use the agent framework for efficient psychological experiments**: By constructing an agent framework (AFSPP), the authors hope to simulate complex psychological scenarios in a virtual environment, which may be difficult to implement or pose ethical risks in actual human experiments. The AFSPP framework can not only improve the efficiency of psychological experiments but also reduce experimental costs. 3. **How to prevent agents from developing undesirable preferences and personalities**: With the increasing demand for trustworthy AI, researchers need to explore how to guide the development of agents to avoid forming unhealthy or harmful personality traits. By analyzing the impact of social networks, planning, and sensory perception on agents' preferences and personalities, researchers can provide valuable insights for the study of trustworthy AI. Specifically, the paper proposes a framework called "Agent Framework for Shaping Preference and Personality (AFSPP)" aimed at shaping agents' preferences and personalities through the influence of social networks and subjective awareness. This framework was validated in a micro-sandbox world called Qunit's Cafe, demonstrating the significant impact of planning, sensory perception, and subjective information in social networks on preference shaping. Additionally, through psychological tests such as MBTI, researchers validated the effectiveness of AFSPP in simulating human psychological experiments.

AFSPP: Agent Framework for Shaping Preference and Personality with Large Language Models

Designing LLM-Agents with Personalities: A Psychometric Approach

PersLLM: A Personified Training Approach for Large Language Models

LMLPA: Language Model Linguistic Personality Assessment

Agentic Society: Merging skeleton from real world and texture from Large Language Model

Human Simulacra: Benchmarking the Personification of Large Language Models

Personality Alignment of Large Language Models

User Behavior Simulation with Large Language Model based Agents

LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models

Driving Generative Agents With Their Personality

Personality Traits in Large Language Models

What makes your model a low-empathy or warmth person: Exploring the Origins of Personality in LLMs

PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits

Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective

Illuminating the Black Box: A Psychometric Investigation into the Multifaceted Nature of Large Language Models

Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data

ControlLM: Crafting Diverse Personalities for Language Models

Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models

Is persona enough for personality? Using ChatGPT to reconstruct an agent's latent personality from simple descriptions

Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents