Abstract:Accurately simulating human opinion dynamics is crucial for understanding a variety of societal phenomena, including polarization and the spread of misinformation. However, the agent-based models (ABMs) commonly used for such simulations often over-simplify human behavior. We propose a new approach to simulating opinion dynamics based on populations of Large Language Models (LLMs). Our findings reveal a strong inherent bias in LLM agents towards producing accurate information, leading simulated agents to consensus in line with scientific reality. This bias limits their utility for understanding resistance to consensus views on issues like climate change. After inducing confirmation bias through prompt engineering, however, we observed opinion fragmentation in line with existing agent-based modeling and opinion dynamics research. These insights highlight the promise and limitations of LLM agents in this domain and suggest a path forward: refining LLMs with real-world discourse to better simulate the evolution of human beliefs.

What problem does this paper attempt to address?

The problem this paper attempts to address is: how to more accurately simulate human opinion dynamics, particularly in social phenomena such as polarization and the spread of misinformation. Traditional agent-based models (ABMs) often oversimplify human behavior, so this study proposes a new approach, using large language models (LLMs) to simulate opinion dynamics. Specifically, the paper explores the following points: 1. **Limitations of existing models**: Traditional ABMs typically require mapping beliefs and messages to numerical values, ignoring the complex linguistic details of real-life conversations. Additionally, these models are usually rule-based and cannot fully simulate the complex interactions between real humans. 2. **Proposing a new method**: The researchers propose an LLM-based agent network to simulate opinion dynamics. These agents can use natural language for input and output, maintain beliefs, and update beliefs through a Transformer-based LLM. 3. **Impact of confirmation bias**: By introducing confirmation bias through prompt engineering, the researchers observed opinion fragmentation consistent with existing ABM and opinion dynamics research. This indicates that LLM agents have both potential and limitations in simulating human opinion dynamics. 4. **Impact of initial opinion distribution**: The study explored the effect of different initial opinion distributions on the final opinion dynamics. The results showed that even if all agents initially held incorrect views, they would eventually converge towards scientific consensus, indicating an inherent tendency of the model to converge towards true opinions. 5. **Performance under different frameworks**: In a false framework, agents were more inclined to deny false statements than to support correct statements in a true framework, further validating the model's inherent bias. In summary, this paper aims to improve the simulation of human opinion dynamics using LLM agents, thereby better understanding social phenomena and providing guidance for future research and applications.

Simulating Opinion Dynamics with Networks of LLM-based Agents

Quantifying the Impact of Large Language Models on Collective Opinion Dynamics

Computational Agent-based Models in Opinion Dynamics: A Survey on Social Simulations and Empirical Studies

Fusing Dynamics Equation: A Social Opinions Prediction Algorithm with LLM-based Agents

Large Language Model-driven Multi-Agent Simulation for News Diffusion Under Different Network Structures

On the Principles behind Opinion Dynamics in Multi-Agent Systems of Large Language Models

Agent-Based Modelling Meets Generative AI in Social Network Simulations

The Wisdom of Partisan Crowds: Comparing Collective Intelligence in Humans and LLM-based Agents

Systematic Biases in LLM Simulations of Debates

Sense and Sensitivity: Evaluating the simulation of social dynamics via Large Language Models

Build An Influential Bot In Social Media Simulations With Large Language Models

Modeling and Analysis of Opinion Dynamics in Social Networks Using Multiple-Population Mean Field Games

Beyond Demographics: Aligning Role-playing LLM-based Agents Using Human Belief Networks

Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms

Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs

Simulating Human Strategic Behavior: Comparing Single and Multi-agent LLMs

Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents

Opinion Dynamics Model Based on the Cognitive Dissonance: an Agent-Based Simulation

Limits of Large Language Models in Debating Humans

Multi-Agent Consensus Seeking via Large Language Models