Abstract:This paper investigates a dynamic confrontation problem where a swarm of agents with weak capabilities confronts multiple targets with strong capabilities. In such hostile situations, the agents typically strive to survive by cooperating to offend the targets and defend against potential attacks from the targets. To enhance the capability of such multi-agent systems, it is necessary to develop an efficient mechanism in which each agent autonomously makes decisions and cooperatively confronts targets. In this paper, a cooperation and decision-making framework is proposed for a multi-agent system confrontation, which is comprised of target allocation, tactical decision-making, and swarm motion control algorithms. First, to address the exponential growth problem of possible behavioral interactions with increasing numbers of agents, a hedonic coalition formation game algorithm is designed for the agents forming disjoint coalitions corresponding to different targets, i.e., the agents cooperating to confront the targets in the form of coalitions. Then, during the stage of attacking or defending the targets, each agent interacts with coalition members through information exchange. To implement effective cooperative behavior and explainable autonomous decision-making, a fuzzy cognitive map is designed to fuse situational information and obtain decision reference information for each agent's tactical decision-making. Moreover, to design effective attack/defense tactics and strategies for each agent, the tactical pursuit point method is utilized to develop a tactical pursuit point for each agent based on the decision reference information. Finally, a swarm motion control algorithm, including decision-oriented and swarm behavior rules, is designed to drive each agent towards the assigned target. Simulation results show the effectiveness of the designed framework and algorithms. In the confrontation, each agent adjusts its strategies according to different situations, occupies advantageous positions, and accomplishes cooperative attack/defense strategies to reduce casualties.

Integrative tactical decision-making of information-based Cooperative Air Combat with ameliorative Lanchester equations

A Novel Antagonistic Weapon-Target Assignment Model Considering Uncertainty and Its Solution Using Decomposition Co-Evolution Algorithm.

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

High-Fidelity Decision-Making and Simulation for Cooperative Autonomous Air Combat Considering the Effect of Flight Controller

Unifying warfighting functions in mathematical modelling: combat, manoeuvre, and C2

Differential game model and its solution for the firepower-assignment in vessel formations in information war

Air Combat Decision Making for Coordinated Multiple Target Attack Using Combinatorial Auction

Hierarchical Reinforcement Learning from Competitive Self-play for Dual-aircraft formation air combat

Over-the-Horizon Air Combat Environment Modeling and Deep Reinforcement Learning Application

Air Combat Maneuver Decision Based on Deep Reinforcement Learning and Game Theory

Analysis of OODA Loop based on Adversarial for Complex Game Environments

Maneuver Decision-Making For Autonomous Air Combat Through Curriculum Learning And Reinforcement Learning With Sparse Rewards

Robust Optimization based Air Combat Game Decision-making of Multi-UAV with Uncertain Information

A cooperation and decision-making framework in dynamic confrontation for multi-agent systems

Research on Cooperative Attack Decision of Unmanned Combat Aerial Vehicles Using Self-Adaptive Grey Wolf Optimization

A New Approach for Target Capability Assessment and Selection in Complex Situations

Research and Effectiveness Analysis of Intelligent Unmanned Equipment Group Collaboration in Combat Simulation System

Research on Integrated Model of Evaluating Combat Effectiveness for Air-to-surface Missile Weapon Systems

Decision-Making Strategies for Close-Range Air Combat Based on Reinforcement Learning with Variable-Scale Actions

An Intelligent Maneuver Decision-Making Approach for Air Combat Based on Deep Reinforcement Learning and Transformer Networks

Optimal confrontation position selecting games model and its application to one-on-one air combat