Abstract:The large language models represented by ChatGPT have a disruptive impact on the field of artificial intelligence. But it mainly focuses on natural language processing, speech recognition, machine learning and natural language understanding. This paper innovatively applies the large language model to the field of intelligent decision-making, places the large language model in the decision-making center, and constructs an agent architecture with the large language model as the core. Based on this, it further proposes a two-layer agent task planning, issues and executes decision commands through the interaction of natural language, and carries out simulation verification through the wargame simulation environment. Through the game confrontation simulation experiment, it is found that the intelligent decision-making ability of the large language model is significantly stronger than the commonly used reinforcement learning AI and rule AI, and the intelligence, understandability and generalization are all better. And through experiments, it was found that the intelligence of the large language model is closely related to prompt. This work also extends the large language model from previous human-computer interaction to the field of intelligent decision-making, which has important reference value and significance for the development of intelligent decision-making.

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve This paper aims to address the application of intelligent decision-making in war game simulations. Specifically, the paper innovatively applies large language models (such as ChatGPT) to the field of intelligent decision-making, constructing an intelligent agent architecture centered around large language models, and proposes a dual-layer agent task planning model. Through natural language interaction, this model can issue and execute decision commands and is validated in a war game simulation environment. ### Main Issues and Challenges 1. **Limitations of Existing Intelligent Decision-Making Methods**: - **Rule-based AI**: Although it does not require long training times, its intelligence level is difficult to break through due to the limitations of rules. - **Data-driven AI and Reinforcement Learning AI**: Although they improve intelligence and flexibility by processing large amounts of data and reinforcement learning algorithms, they have poor interpretability and are difficult to transfer models when scenarios and key points change. 2. **Complexity and Continuity of Adversarial Game Decision-Making**: - The decision-making process of adversarial games is complex and continuous, requiring higher intelligence and generalization capabilities. ### Solutions 1. **Automatically Generated AI War Game Architecture**: - Constructed an intelligent agent architecture centered around large language models, consisting of multiple generative agents, each with its own large language model (this paper uses ChatGPT as the driving tool). These intelligent agents can communicate and cooperate through reflection and memory streams to make decisions together. 2. **Dual-layer Agent Task Planning Model**: - The strategic agent is responsible for describing the specific situations observed by all agents and assigning and executing tasks based on all observed situational information. - The tactical agent focuses on the situations observed by individual agent pieces and executes related tasks according to the strategic agent's planning. The tactical agent can also make its own judgments and feedback based on the strategic agent's prompts. 3. **Experimental Validation**: - Through war game simulation experiments, it was verified that the intelligent decision-making ability of large language models is significantly better than commonly used reinforcement learning AI and rule-based AI, and performs better in terms of intelligence, interpretability, and generalization capabilities. - The experiments also found that providing domain expert prior knowledge to large language models can significantly improve their intelligence level. ### Conclusion This work innovatively applies large language models to the field of intelligent decision-making and validates its feasibility on a war game platform. Compared to reinforcement learning-based intelligent decision-making, large language models exhibit stronger adaptability, intelligence, and generalization capabilities in actual game confrontations. Additionally, the study found that the intelligence level of large language models is closely related to their prompts, and appropriate prompts can significantly improve their performance. Nevertheless, this work is still in the preliminary exploration stage, and there are many innovative works that can be carried out in the future, such as trying the application of large language models in different scenarios and further enhancing the intelligence level of adversaries in more complex adversarial environments.

Self Generated Wargame AI: Double Layer Agent Task Planning Based on Large Language Model

Intelligent Decision-Making and Human Language Communication Based on Deep Reinforcement Learning in a Wargame Environment

Large Scale Deep Reinforcement Learning in War-games.

Open-Ended Wargames with Large Language Models

The Rise and Potential of Large Language Model Based Agents: A Survey

TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage

Large Language Models as Agents in Two-Player Games

Large Language Model As Autonomous Decision Maker

Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives

Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions

A Survey on Large Language Model-Based Game Agents

Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects

Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Large Language Models on the Chessboard: A Study on ChatGPT's Formal Language Comprehension and Complex Reasoning Skills

AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation

TPTU: Task Planning and Tool Usage of Large Language Model-based AI Agents

GameVLM: A Decision-making Framework for Robotic Task Planning Based on Visual Language Models and Zero-sum Games

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

Controllable Conversations: Planning-Based Dialogue Agent with Large Language Models

Introspective Tips: Large Language Model for In-Context Decision Making

Self-driven Grounding: Large Language Model Agents with Automatical Language-aligned Skill Learning