Abstract:Multiple unmanned aerial vehicle (multi-UAV) cooperative air combat, which is an important form of future air combat, has high requirements for the autonomy and cooperation of unmanned aerial vehicles. Therefore, it is of great significance to study the decision-making method of multi-UAV cooperative air combat since the conventional methods are challenging to solve the high complexity and highly dynamic cooperative air combat problems. This paper proposes a multi-agent double-soft actor-critic (MADSAC) algorithm for solving the cooperative decision-making problem of multi-UAV. The MADSAC achieves multi-UAV cooperative air combat by treating the problem as a fully cooperative game using a decentralized partially observable Markov decision process and a centrally trained distributed execution framework. The use of maximum entropy theory in the update process makes the method more exploratory. Meanwhile, MADSAC uses double-centralized critics, target networks, and delayed policy updates to solve the overestimation and error accumulation problems effectively. In addition, the double-centralized critics based on the attention mechanism improve the scalability and learning efficiency of MADSAC. Finally, multi-UAV cooperative air combat experiments validate the effectiveness of MADSAC.

Research on Multi-Agent Decision Support System of Underwater Acoustic Countermeasure in Submarine

Research on Decision-making Support System Application for Remote Sensing Integrated Survey of Land Resources

Research on Decision Method of Multiple Acoustic Decoy Synergistic Against Acoustic Homing Underwater Vehicle

Research on Warfare Simulation System for Continuous Explosive Underwater Acoustic Decoy

Deep Learning-based Decision-Making Model for the Submarine Evade Movement

Simulation System Design of Underwater Acoustic Countermeasure

The Application of Intelligent Decision Support System Based on Multi-Agent in the Field of Engineering

Modeling and Simulation of Acoustic Countermeasure Equipments

A Multi-Agent-Based Defense System Design for Multiple Unmanned Surface Vehicles

Research Advance in Underwater Detection of Marine Status for Underwater Vehicles

Airborne Multi-Agent Information Fusion and Decision-Making System

Research on Low-Frequency Remote Programmable Sound Source System

Decision-Making Of Underwater Cooperative Confrontation Based On Modpso

Distributed intelligent air-defense command and decision system based on multi-agent

Research on the Construction of Underwater Platform Combat Deduction System Based on Service-Oriented and Multi-agent Technology

The Study of Surface Vessel Integrated Underwater Defence Effectiveness Evaluation on newly Decision-centric warfare

Research on Distributed Project Management Decision Support System Based on Multi-Agent Technology

Underwater Acoustic Multi-Target Recognition Algorithm Based on Hierarchical Information Fusion Structure

Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic

Architecture of an Operational Decision-Making Support System Based on Multi-Agent

Multi-Submarines Detection Using Multistatic Sonar System