Abstract:This paper investigates the rationality of large language models (LLMs) in strategic decision-making contexts, specifically within the framework of game theory. We evaluate several state-of-the-art LLMs across a spectrum of complete-information and incomplete-information games. Our findings reveal that LLMs frequently deviate from rational strategies, particularly as the complexity of the game increases with larger payoff matrices or deeper sequential trees. To address these limitations, we design multiple game-theoretic workflows that guide the reasoning and decision-making processes of LLMs. These workflows aim to enhance the models' ability to compute Nash Equilibria and make rational choices, even under conditions of uncertainty and incomplete information. Experimental results demonstrate that the adoption of these workflows significantly improves the rationality and robustness of LLMs in game-theoretic tasks. Specifically, with the workflow, LLMs exhibit marked improvements in identifying optimal strategies, achieving near-optimal allocations in negotiation scenarios, and reducing susceptibility to exploitation during negotiations. Furthermore, we explore the meta-strategic considerations of whether it is rational for agents to adopt such workflows, recognizing that the decision to use or forgo the workflow constitutes a game-theoretic issue in itself. Our research contributes to a deeper understanding of LLMs' decision-making capabilities in strategic contexts and provides insights into enhancing their rationality through structured workflows. The findings have implications for the development of more robust and strategically sound AI agents capable of navigating complex interactive environments. Code and data supporting this study are available at \url{<a class="link-external link-https" href="https://github.com/Wenyueh/game_theory" rel="external noopener nofollow">this https URL</a>}.

LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay

LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay

AvalonBench: Evaluating LLMs Playing the Game of Avalon

Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information

Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game

From Text to Tactic: Evaluating LLMs Playing the Game of Avalon

Instigating Cooperation among LLM Agents Using Adaptive Information Modulation

Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplation

Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents

I Want to Break Free! Persuasion and Anti-Social Behavior of LLMs in Multi-Agent Settings with Social Hierarchy

A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarios

Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

Embodied LLM Agents Learn to Cooperate in Organized Teams

MetaAgents: Simulating Interactions of Human Behaviors for LLM-based Task-oriented Coordination via Collaborative Generative Agents

Do LLM Agents Exhibit Social Behavior?

AntEval: Evaluation of Social Interaction Competencies in LLM-Driven Agents

LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation

Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Games

InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Context

Game-theoretic LLM: Agent Workflow for Negotiation Games