Abstract:Large language models (LLMs) have been shown to face hallucination issues due to the data they trained on often containing human bias; whether this is reflected in the decision-making process of LLM Agents remains under-explored. As LLM Agents are increasingly employed in intricate social environments, a pressing and natural question emerges: Can we utilize LLM Agents' systematic hallucinations to mirror human cognitive biases, thus exhibiting irrational social intelligence? In this paper, we probe the irrational behavior among contemporary LLM Agents by melding practical social science experiments with theoretical insights. Specifically, We propose CogMir, an open-ended Multi-LLM Agents framework that utilizes hallucination properties to assess and enhance LLM Agents' social intelligence through cognitive biases. Experimental results on CogMir subsets show that LLM Agents and humans exhibit high consistency in irrational and prosocial decision-making under uncertain conditions, underscoring the prosociality of LLM Agents as social entities and highlighting the significance of hallucination properties. Additionally, the CogMir framework demonstrates its potential as a valuable platform for encouraging more research into the social intelligence of LLM Agents.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to explore the irrational behavior of large language model (LLM) agents in social decision - making, especially by using the systematic hallucination property of LLM agents to reflect human cognitive biases, thereby demonstrating their social intelligence. Specifically, the researchers proposed an open - framework named CogMir, aiming to evaluate and enhance the social intelligence of LLM agents, especially their performance in terms of cognitive biases. By combining actual social science research with theoretical insights, the paper explored whether LLM agents can simulate human cognitive biases through their systematic hallucination property, and thus exhibit human - like irrational social intelligence.
### Main contributions of the paper:
1. **First break through the bottleneck of the black - box theory of multi - LLM - agent social intelligence**: By using the systematic hallucination property of LLM agents as an explanatory and controllable variable, systematically evaluate and explain the social intelligence of LLM agents from the perspective of evolutionary sociology.
2. **Propose the CogMir framework**: This is an extensible, modular and dynamic multi - LLM - agent framework for evaluating, utilizing and explaining social intelligence through cognitive biases, which is consistent with social science methodologies.
3. **Provide diverse CogMir subsets and use cases**: The experimental results highlight the similarities and differences between LLM agents and humans in the decision - making process.
4. **Emphasize the prosocial behavior of LLM agents in irrational decision - making**: Point out the important role of the hallucination property in the social intelligence of LLM agents.
### Research background and motivation:
- **Systematic hallucination of LLM agents**: Due to biases in the training data, LLM agents are prone to produce systematic hallucinations, that is, generating inaccurate or misleading information.
- **Universality of cognitive biases**: Cognitive biases are widespread in human society, and these biases may lead to irrational decisions and imaginary content.
- **Importance of social intelligence**: As LLM agents are increasingly applied to complex social environments, it becomes particularly important to study their social intelligence.
### Experimental design:
- **CogMir framework**: This framework is divided into four main parts: mirror - environment setting, framework structure, cognitive - bias subset and sample use cases.
- **Cognitive - bias subset**: It includes the herd effect, the authority effect, the Benjamin Franklin effect, the rumor - chain effect, the gambler's fallacy, the confirmation bias and the halo effect.
- **Evaluation indicators**: They include the question - and - answer bias rate (Q&A Bias Rate) and the multi - human - LLM - agent interaction bias rate (Multi - H - A Bias Rate), which are used to quantify the tendency of LLM agents to show cognitive biases in different situations.
### Experimental results:
- **Herd effect**: LLM agents show different conformist behaviors when facing known and unknown information, but generally, their behavior patterns are similar to those of humans.
- **Authority effect**: Under the influence of authoritative cues, LLM agents have a high degree of obedience in certain and uncertain situations, showing stronger obedience than the herd effect.
In general, through the CogMir framework, this paper systematically studied the irrational behavior of LLM agents in social decision - making and revealed the cognitive - bias mechanisms behind these behaviors, providing new perspectives and tools for future research.