Abstract:Due to the characteristics of the small size and low cost of unmanned aerial vehicles (UAVs), Multi-UAV confrontation will play an important role in future wars. The Multi-UAV confrontation game in the air combat environment is investigated in this paper. To truly deduce the confrontation scene, a physics engine is established based on the Multi-UAV Confrontation Scenario (MCS) framework, enabling the real-time interaction between the agent and environment while making the learned strategies more realistic. To form an effective confrontation strategy, the Graph Attention Multi-agent Soft Actor Critic Reinforcement Learning with Target Predicting Network (GA-MASAC-TP Net) is firstly proposed for Multi-UAV confrontation game. The merits lie in that the Multi-UAV trajectory prediction, considering interactions among targets, is incorporated innovatively into the Multi-agent reinforcement learning (MARL), enabling Multi-UAVs to make decisions more accurately based on situation prediction. Specifically, the Soft Actor Critic (SAC) algorithm is extended to the Multi-agent domain and embed with the graph attention neural network into the Actor, Critic network, so the UAV could aggregate the information of the spatial neighbor teammates based on the attention mechanism for better collaboration. The comparative experiment and ablation study demonstrate the effectiveness of the proposed algorithm and the state-of-art performance in the MCS.

Situation-driven Fuzzy Cognitive Maps Applied in Air-to-ground Target Attack

Cooperative Threat Assessment of Multi-Aircrafts Based on Synthetic Fuzzy Cognitive Map

Autonomous attack decision-making of UCAV based on ABFCM model framework

Cooperative Effect Analysis of Manned/unmanned Aerial Vehicle Team Based on Fuzzy Cognition Map

Limited Intervention Collaborative Decision Making of MAV-UAV Team Based on VFCM

Modeling Air Combat Situation Assessment by Using Fuzzy Dynamic Bayesian Network

Application of Fuzzy Cognitive Maps in Fuel Management of Airborne Warning and Control Systems

Modeling and Simulation of a Controlled/Autonomous CCRP Attack System for UCAVs

Dynamic Target Assignment Method for UCAV Fleet Using Memory Enhanced Dynamic UMDA

Limited Intervention Collaborative Decision-Making Of Mav/Uav Team Based On Fcm

Multiple UCAVs Cooperative Path Planning in Dynamic Environments

Improving Identification Capability of UCAV (Unmanned Combating Air Vehicle)

Research on Command and Decision System Architecture of Cooperative Formation Air-to-ground Attack

Study on Mission Planning for UCAVs Attacking Time Constrained Targets

A Comprehensive Threat Assessment Method for Group Aircrafts Cooperative Air Defensive Combat under Command of AWACS

Target Assignment in Cooperative Attacking of UCAVs Based on Multi-Intelligence Improved Glowworm Swarm Optimization Algorithm

Decision-Making Based on Fuzzy Neural Network for Air Combat of Multi-Aircraft Against Multi-Target

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

Real-time Decentralized Cooperative Robust Trajectory Planning for Multiple UCAVs Air-to-ground Target Attack

Research on Air-to-ground Multi-target Sequential Attack Decision for Unmanned Combat Air Vehicle

A Rough Decision-making Model for UCAV Based on On-line Correction Time Series Forecasting Method