Abstract:This paper investigates how agents learn and perform efficient strategies by trying different actions in asymmetric confrontation setting. Firstly, we use Gomoku as an example to analyse the causes and impacts of asymmetric confrontation: the first mover gains higher power than the second mover. We find that the first mover learns how to attack quickly while it is difficult for the second mover to learn how to defend since it cannot win the first mover and always receives negative rewards. As such, the game is stuck at a deadlock in which the first mover cannot make further advances to learn how to defend, and the second mover learns nothing. Secondly, we propose an ancillary mechanism (AM) to add two principles to the agent's actions to overcome this difficulty. AM is a guidance for the agents to reduce the learning difficulty and to improve their behavioural quality. To the best of our knowledge, this is the first study to define asymmetric confrontation in reinforcement learning and propose approaches to tackle such problems. In the numerical tests, we first conduct a simple human vs AI experiment to calibrate the learning process in asymmetric confrontation. Then, an experiment of 15*15 Gomoku game by letting two agents (with AM and without AM) compete is applied to check the potential of AM. Results show that adding AM can make both the first and the second movers become stronger in almost the same amount of calculation.

A New C 2 Model Based on Confrontation Analysis * Topic 1

A New Military Decision-Making Model from Cognitive Perspective

Assessment of Command and Control organization structures based on confrontation analysis 1 Topic 7

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

Modeling and analysis of command and control system in cooperative air combat

A Situation and Threat Assessment Model Based on Group Analysis

Research of Conceptual Model Based on Attack and Defense System Design

Multi-level Descriptive Model of Task-oriented C2 Organization

A reconciliation model of agile C2 organization based on converged networks

Integrative tactical decision-making of information-based Cooperative Air Combat with ameliorative Lanchester equations

Research on Modeling of Exploratory Analysis Model for C2 Organization

Artificial Intelligence in Modeling Command and Control

A new model of conflict analysis — the three dimensional graph model

A cognitive model of human thinking.

Descriptions and Designing of C2 Organizational in Battlefields

Behavior Modeling of Air to Ship Fighter Based on Context-Based Reasoning

Integration Environment of Test Bed for C2 Organization

Opinion Dynamics in Networked Command and Control Organizations

Cognitive Modeling for Crew's Information Processing Based on Multi-resource Theory

Research on Methodology of Designing C2 Organizations

DAN Approach to Designing C2 Organization