Abstract:As LLMs increasingly take on roles in human-AI interactions and autonomous AI systems, understanding their social behavior becomes important for informed use and continuous improvement. However, their behaviors in social interactions with humans and other agents, as well as the mechanisms shaping their responses, remain underexplored. To address this gap, we introduce a novel probabilistic framework, State-Understanding-Value-Action (SUVA), to systematically analyze LLM responses in social contexts based on their textual outputs (i.e., utterances). Using canonical behavioral economics games and social preference concepts relatable to LLM users, SUVA assesses LLMs' social behavior through both their final decisions and the response generation processes leading to those decisions. Our analysis of eight LLMs -- including two GPT, four LLaMA, and two Mistral models -- suggests that most models do not generate decisions aligned solely with self-interest; instead, they often produce responses that reflect social welfare considerations and display patterns consistent with direct and indirect reciprocity. Additionally, higher-capacity models more frequently display group identity effects. The SUVA framework also provides explainable tools -- including tree-based visualizations and probabilistic dependency analysis -- to elucidate how factors in LLMs' utterance-based reasoning influence their decisions. We demonstrate that utterance-based reasoning reliably predicts LLMs' final actions; references to altruism, fairness, and cooperation in the reasoning increase the likelihood of prosocial actions, while mentions of self-interest and competition reduce them. Overall, our framework enables practitioners to assess LLMs for applications involving social interactions, and provides researchers with a structured method to interpret how LLM behavior arises from utterance-based reasoning.

LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay

LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay

Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game

Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information

AvalonBench: Evaluating LLMs Playing the Game of Avalon

From Text to Tactic: Evaluating LLMs Playing the Game of Avalon

Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents

Instigating Cooperation among LLM Agents Using Adaptive Information Modulation

Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

I Want to Break Free! Persuasion and Anti-Social Behavior of LLMs in Multi-Agent Settings with Social Hierarchy

Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplation

MetaAgents: Simulating Interactions of Human Behaviors for LLM-based Task-oriented Coordination via Collaborative Generative Agents

What if LLMs Have Different World Views: Simulating Alien Civilizations with LLM-based Agents

A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarios

AgentBench: Evaluating LLMs as Agents

Do LLM Agents Exhibit Social Behavior?

Embodied LLM Agents Learn to Cooperate in Organized Teams

Agentverse: Facilitating multi-agent collaboration and exploring emergent behaviors in agents

Artificial Leviathan: Exploring Social Evolution of LLM Agents Through the Lens of Hobbesian Social Contract Theory

LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation