Abstract:Wargames are essential simulators for various war scenarios. However, the increasing pace of warfare has rendered traditional wargame decision-making methods inadequate. To address this challenge, wargame-assisted decision-making methods that leverage artificial intelligence techniques, notably reinforcement learning, have emerged as a promising solution. The current wargame environment is beset by a large decision space and sparse rewards, presenting obstacles to optimizing decision-making methods. To overcome these hurdles, a Multi-Agent Deep Deterministic Policy Gradient (MADDPG) based wargame decision-making method is presented. The Partially Observable Markov Decision Process (POMDP), joint action-value function, and the Gumbel-Softmax estimator are applied to optimize MADDPG in order to adapt to the wargame environment. Furthermore, a wargame decision-making method based on the improved MADDPG algorithm is proposed. Using supervised learning in the proposed approach, the training efficiency is improved and the space for manipulation before the reinforcement learning phase is reduced. In addition, a policy gradient estimator is incorporated to reduce the action space and to obtain the global optimal solution. Furthermore, an additional reward function is designed to address the sparse reward problem. The experimental results demonstrate that our proposed wargame decision-making method outperforms the pre-optimization algorithm and other algorithms based on the AC framework in the wargame environment. Our approach offers a promising solution to the challenging problem of decision-making in wargame scenarios, particularly given the increasing speed and complexity of modern warfare.

Technical Direction Analysis on Multi-Branch Large-Sample Wargaming: A Hybrid Intelligence Based Solution to Future Command & Control

Modeling and analysis of command and control system in cooperative air combat

Intelligent Decision-Making Based on Neural Network and Simulation in Two Islands Air Defense Operation

A Neural Network-Based Intelligent Decision-Making in the Air-Offensive Campaign with Simulation

Analysis of the Progress of Aircraft Game Guidance

Multi-agent Task Assignment Based on the Situation Field and Game Theory

An Algorithm Based on Game Theory for Exploring How to Obtain NCW(Network Centric Warfare) Information Superiority in 1 vs 1 Air Combat

Deep AI military staff: cooperative battlefield situation awareness for commander’s decision making

King of the Hill: C2 for Next Generation Swarm Warfare

Analysis of the Impact of Situational Awareness Effectiveness Based on Wargame

The Development Tendency of Artificial Intelligence in Command and Control: A Brief Survey

Intelligent Decision-Making and Human Language Communication Based on Deep Reinforcement Learning in a Wargame Environment

The Future of Collaborative Human-Artificial Intelligence Decision-Making for Mission Planning

Scaling Artificial Intelligence for Digital Wargaming in Support of Decision-Making

Research on Large-scale Model System Management Technology for Joint Operations

Multi-attribute Decision-Making in Wargames Leveraging the Entropy-Weight Method in Conjunction with Deep Reinforcement Learning

Research on Wargame Decision-Making Method Based on Multi-Agent Deep Deterministic Policy Gradient

Method for making multi-attribute decisions in wargames by combining intuitionistic fuzzy numbers with reinforcement learning

The Solution of Target Assignment Problem in Command and Control Decision-Making Behaviour Simulation.

Research on Architecture of Intelligent Command and Control System

Battlefield Target Intelligence System Architecture Modeling and System Optimization