Abstract:This paper investigates a dynamic confrontation problem where a swarm of agents with weak capabilities confronts multiple targets with strong capabilities. In such hostile situations, the agents typically strive to survive by cooperating to offend the targets and defend against potential attacks from the targets. To enhance the capability of such multi-agent systems, it is necessary to develop an efficient mechanism in which each agent autonomously makes decisions and cooperatively confronts targets. In this paper, a cooperation and decision-making framework is proposed for a multi-agent system confrontation, which is comprised of target allocation, tactical decision-making, and swarm motion control algorithms. First, to address the exponential growth problem of possible behavioral interactions with increasing numbers of agents, a hedonic coalition formation game algorithm is designed for the agents forming disjoint coalitions corresponding to different targets, i.e., the agents cooperating to confront the targets in the form of coalitions. Then, during the stage of attacking or defending the targets, each agent interacts with coalition members through information exchange. To implement effective cooperative behavior and explainable autonomous decision-making, a fuzzy cognitive map is designed to fuse situational information and obtain decision reference information for each agent's tactical decision-making. Moreover, to design effective attack/defense tactics and strategies for each agent, the tactical pursuit point method is utilized to develop a tactical pursuit point for each agent based on the decision reference information. Finally, a swarm motion control algorithm, including decision-oriented and swarm behavior rules, is designed to drive each agent towards the assigned target. Simulation results show the effectiveness of the designed framework and algorithms. In the confrontation, each agent adjusts its strategies according to different situations, occupies advantageous positions, and accomplishes cooperative attack/defense strategies to reduce casualties.

Making Decisions on Proper Cooperation Tactics for Multiple Fighters to Combat from Beyond Visual Range (BVR) to Within Visual Range (WVR)

A Multi-UCAV cooperative occupation method based on weapon engagement zones for beyond-visual-range air combat

High-Fidelity Decision-Making and Simulation for Cooperative Autonomous Air Combat Considering the Effect of Flight Controller

Explainable Basic-Fighter-Maneuver Decision Support Scheme for Piloting Within-Visual-Range Air Combat

Cross coordination of behavior clone and reinforcement learning for autonomous within-visual-range air combat

Cooperative Guidance Law with Maneuverability Awareness: A Decentralized Solution

Decision-Making Strategies for Close-Range Air Combat Based on Reinforcement Learning with Variable-Scale Actions

Engagement Decision Support for Beyond Visual Range Air Combat

Vision-Based 3D Aerial Target Detection and Tracking for Maneuver Decision in Close-Range Air Combat

Cooperative Target Enclosing Control for Multiple Unmanned Surface Vehicles with Unknown Dynamics and Safety Assurance

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

Hierarchical Reinforcement Learning from Competitive Self-play for Dual-aircraft formation air combat

Autonomous Maneuver Decision Making of Dual-UAV Cooperative Air Combat Based on Deep Reinforcement Learning

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

An Effective and Scalable Approach for Swarm-on-Swarm Air Combat Decision

A Multi-Target Consensus-Based Auction Algorithm for Distributed Target Assignment in Cooperative Beyond-Visual-Range Air Combat

BVR Gym: A Reinforcement Learning Environment for Beyond-Visual-Range Air Combat

Multi-intent autonomous decision-making for air combat with deep reinforcement learning

UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning

Cooperative Strategies with Boundary Conditions for Optimal Aircraft Simultaneous Attack

A cooperation and decision-making framework in dynamic confrontation for multi-agent systems