Abstract:Autonomous maneuver decision making is the core of intelligent warfare, which has become the main research direction to enable unmanned aerial vehicles (UAVs) to independently generate control commands and complete air combat tasks according to environmental situation information. In this paper, an autonomous maneuver decision making method is proposed for air combat by two cooperative UAVs, which is showcased by using the typical olive formation strategy as a practical example. First, a UAV situation assessment model based on the relative situation is proposed, which uses the real-time target and UAV location information to assess the current situation or threat. Second, the continuous air combat state space is discretized into a 13 dimensional space for dimension reduction and quantitative description, and 15 typical action commands instead of a continuous control space are designed to reduce the difficulty of UAV training. Third, a reward function is designed based on the situation assessment which includes the real-time gain due to maneuver and the final combat winning/losing gain. Fourth, an improved training data sampling strategy is proposed, which samples the data in the experience pool based on priority to accelerate the training convergence. Fifth, a hybrid autonomous maneuver decision strategy for dual-UAV olive formation air combat is proposed which realizes the UAV capability of obstacle avoidance, formation and confrontation. Finally, the air combat task of dual-UAV olive formation is simulated and the results show that the proposed method can help the UAVs defeat the enemy effectively and outperforms the deep Q network (DQN) method without priority sampling in terms of the convergence speed.

UAV Cooperative Air Combat Maneuvering Decision-Making Using GRU-MAPPO

UAV Cooperative Search Based on Multi-agent Generative Adversarial Imitation Learning

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

UCAV Air Combat Maneuver Decisions Based on a Proximal Policy Optimization Algorithm with Situation Reward Shaping

Multiple-UAV Reinforcement Learning Algorithm Based on Improved PPO in Ray Framework

Mean policy-based proximal policy optimization for maneuvering decision in multi-UAV air combat

UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning

[Development of specific immunotherapy technics in immediate hypersensitivity].

UAV maneuver decision-making via deep reinforcement learning for short-range air combat

A Graph-Based PPO Approach in Multi-UAV Navigation for Communication Coverage

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

An Improved PPO for Multiple Unmanned Aerial Vehicles

Autonomous Maneuver Decision Making of Dual-UAV Cooperative Air Combat Based on Deep Reinforcement Learning

Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic

Proximal Policy Optimization for Multi-rotor UAV Autonomous Guidance, Tracking and Obstacle Avoidance

DTPPO: Dual-Transformer Encoder-based Proximal Policy Optimization for Multi-UAV Navigation in Unseen Complex Environments

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

Autonomous Defense of Unmanned Aerial Vehicles Against Missile Attacks Using a GRU-Based PPO Algorithm

Multi-UAV Cooperative Target Assignment Method Based on Reinforcement Learning

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

UCAV Autonomous Maneuvering Decision Based on Curriculum Learning Mechanism Training