Abstract:This paper investigates how agents learn and perform efficient strategies by trying different actions in asymmetric confrontation setting. Firstly, we use Gomoku as an example to analyse the causes and impacts of asymmetric confrontation: the first mover gains higher power than the second mover. We find that the first mover learns how to attack quickly while it is difficult for the second mover to learn how to defend since it cannot win the first mover and always receives negative rewards. As such, the game is stuck at a deadlock in which the first mover cannot make further advances to learn how to defend, and the second mover learns nothing. Secondly, we propose an ancillary mechanism (AM) to add two principles to the agent's actions to overcome this difficulty. AM is a guidance for the agents to reduce the learning difficulty and to improve their behavioural quality. To the best of our knowledge, this is the first study to define asymmetric confrontation in reinforcement learning and propose approaches to tackle such problems. In the numerical tests, we first conduct a simple human vs AI experiment to calibrate the learning process in asymmetric confrontation. Then, an experiment of 15*15 Gomoku game by letting two agents (with AM and without AM) compete is applied to check the potential of AM. Results show that adding AM can make both the first and the second movers become stronger in almost the same amount of calculation.

A New Military Decision-Making Model from Cognitive Perspective

A New C 2 Model Based on Confrontation Analysis * Topic 1

Coordination Theory-Based Model of Military Decision Making Process

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

Assessment of Command and Control organization structures based on confrontation analysis 1 Topic 7

A Situation and Threat Assessment Model Based on Group Analysis

Integrative tactical decision-making of information-based Cooperative Air Combat with ameliorative Lanchester equations

Modeling of Military Decision-Making Based on Multi-Agent Influence Diagrams and Games

Decision-Making for Air Combat Dogfight

Research of Conceptual Model Based on Attack and Defense System Design

Multi-level Descriptive Model of Task-oriented C2 Organization

An Application of Fuzzy Decision Theory in Combat Decision Simulation

Autonomous attack decision-making of UCAV based on ABFCM model framework

Decision-making Method for the Optimal Coordination of Fire and Electronic Warfare Based on Integrative Effectiveness

Analyzing and Designing the Military Organization in the Battlefields of Information Age

Analysis of Collaborative Decision-Making Consistency of Warship Formation

Cognitive Modeling for Crew's Information Processing Based on Multi-resource Theory

A Multimodal Interaction Model for Battlefield

Effectiveness Evaluation of Warfare Command Systems with Dissymmetrical Warfare Information

A Situation Cognition Model Based on Human-machine Hybrid Fusion

A Neural Network-Based Intelligent Decision-Making in the Air-Offensive Campaign with Simulation