Abstract:Autonomous maneuver decision making is the core of intelligent warfare, which has become the main research direction to enable unmanned aerial vehicles (UAVs) to independently generate control commands and complete air combat tasks according to environmental situation information. In this paper, an autonomous maneuver decision making method is proposed for air combat by two cooperative UAVs, which is showcased by using the typical olive formation strategy as a practical example. First, a UAV situation assessment model based on the relative situation is proposed, which uses the real-time target and UAV location information to assess the current situation or threat. Second, the continuous air combat state space is discretized into a 13 dimensional space for dimension reduction and quantitative description, and 15 typical action commands instead of a continuous control space are designed to reduce the difficulty of UAV training. Third, a reward function is designed based on the situation assessment which includes the real-time gain due to maneuver and the final combat winning/losing gain. Fourth, an improved training data sampling strategy is proposed, which samples the data in the experience pool based on priority to accelerate the training convergence. Fifth, a hybrid autonomous maneuver decision strategy for dual-UAV olive formation air combat is proposed which realizes the UAV capability of obstacle avoidance, formation and confrontation. Finally, the air combat task of dual-UAV olive formation is simulated and the results show that the proposed method can help the UAVs defeat the enemy effectively and outperforms the deep Q network (DQN) method without priority sampling in terms of the convergence speed.

Automated Maneuvering Decision for UAVs in Forest Surveillance and Fire Detection Missions

Intelligent Path Planning and Following for UAVs in Forest Surveillance and Fire Fighting Missions

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

A UAV-Based Forest Fire Patrol Path Planning Strategy

Fault-tolerant cooperative navigation of networked UAV swarms for forest fire monitoring

Autonomous Maneuver Decision Making of Dual-UAV Cooperative Air Combat Based on Deep Reinforcement Learning

Integrated Design of Cooperative Area Coverage and Target Tracking with Multi-UAV System

Study on Multi-UAV Cooperative Path Planning for Complex Patrol Tasks in Large Cities

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning

A Hierarchical Decision-Making Method with a Fuzzy Ant Colony Algorithm for Mission Planning of Multiple UAVs

A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning

Multi-UAV Cooperative Swarm Algorithm in Air Combat Based on Predictive Game Tree

Unmanned Aerial Vehicle Formation Inspired by Bird Flocking and Foraging behavior

Cooperative Sensing Enhanced UAV Path-Following and Obstacle Avoidance with Variable Formation

Maneuver Decision of UAV in Short-Range Air Combat Based on Deep Reinforcement Learning

Distributed Cooperative Search Algorithm With Task Assignment and Receding Horizon Predictive Control for Multiple Unmanned Aerial Vehicles

Towards Multi-robot Exploration: A Decentralized Strategy for UAV Forest Exploration