Abstract:Integrating large language model (LLM) agents within game theory demonstrates their ability to replicate human-like behaviors through strategic decision making. In this paper, we introduce an augmented LLM agent, called the private agent, which engages in private deliberation and employs deception in repeated games. Utilizing the partially observable stochastic game (POSG) framework and incorporating in-context learning (ICL) and chain-of-thought (CoT) prompting, we investigated the private agent's proficiency in both competitive and cooperative scenarios. Our empirical analysis demonstrated that the private agent consistently achieved higher long-term payoffs than its baseline counterpart and performed similarly or better in various game settings. However, we also found inherent deficiencies of LLMs in certain algorithmic capabilities crucial for high-quality decision making in games. These findings highlight the potential for enhancing LLM agents' performance in multi-player games using information-theoretic approaches of deception and communication with complex environments.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in multi - agent systems, by enhancing the capabilities of large language model (LLM) agents, enabling them to conduct private thinking in repeated games and adopt deception strategies, so as to achieve higher long - term gains in competitive and cooperative scenarios. Specifically, the paper introduces an enhanced LLM agent called "private agent", which is capable of private thinking and deceiving other agents when necessary. The researchers use the partially observable stochastic game (POSG) framework to simulate the behaviors of these agents, and implement private thinking through in - context learning (ICL) and chain - of - thought (CoT) techniques. In addition, the paper also explores how these techniques affect the performance of agents in different types of games, especially normal - form games with different equilibrium types. The main contributions of the paper include: - Using the POSG framework to formalize LLM - based agent games. - Verifying the effectiveness of POSG elements in finding optimal solutions, and identifying the weaknesses of LLM in sampling from probability distributions and making conclusions based on samples, especially the lack of basic Bayesian reasoning ability. - Introducing the concept of private LLM agents, which utilize ICL and CoT techniques and are able to conduct private thinking when considering future and past actions. The researchers compare the performance of private agents with that of baseline agents and analyze their deception strategies. - Conducting a wide - range evaluation of the performance of private agents in various normal - form games with different intrinsic characteristics to examine the behavior coverage under different equilibrium types. - Conducting a sensitivity analysis, designing experiments to change the input parameters of normal - form games, making the reward matrix shift from competition to cooperation, while examining the influence of different underlying LLM, agent types, and number of game steps. In summary, this paper aims to explore and verify the potential of enhancing the decision - making ability and performance of LLM agents in multi - player games through private thinking and deception strategies.

Effect of Private Deliberation: Deception of Large Language Models in Game Play

Deception in Reinforced Autonomous Agents

MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration

Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?

From Text to Tactic: Evaluating LLMs Playing the Game of Avalon

Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation

Strategic Interactions between Large Language Models-based Agents in Beauty Contests

Simulating Human Strategic Behavior: Comparing Single and Multi-agent LLMs

Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framing

Are Large Language Models Strategic Decision Makers? A Study of Performance and Bias in Two-Player Non-Zero-Sum Games

Deception Abilities Emerged in Large Language Models

Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information

Evaluating Creativity and Deception in Large Language Models: A Simulation Framework for Multi-Agent Balderdash

Reproducing and Extending Experiments in Behavioral Strategy with Large Language Models

Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Game

Playing Games With GPT: What Can We Learn About a Large Language Model From Canonical Strategic Games?

Theory of Mind for Multi-Agent Collaboration via Large Language Models

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

Large Language Models Playing Mixed Strategy Nash Equilibrium Games

Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Models

Logic-Enhanced Language Model Agents for Trustworthy Social Simulations