Abstract:Unmanned aircraft systems can perform some more dangerous and difficult missions than manned aircraft systems. In some highly complicated and changeable tasks, such as air combat, the maneuvering decision mechanism is required to sense the combat situation accurately and make the optimal strategy in real-time. This paper presents a formulation of a 3-D one-on-one air combat maneuvering problem and an approximate dynamic programming approach for computing an optimal policy on autonomous maneuvering decision making. The aircraft learns combat strategies in a Reinforcement Leaning method, while sensing the environment, taking available maneuvering actions and getting feedback reward signals. To solve the problem of dimensional explosion in the air combat, the proposed method is implemented through feature selection, trajectory sampling, function approximation and Bellman backup operation in the air combat simulation environment. This approximate dynamic programming approach provides a fast response to a rapidly changing tactical situation, learns in long-term planning, without any explicitly coded air combat rule base.

Application of interval numbers decision to UCAV attack-defends game theory

Multi-UAV Counter-Game Model Based on Uncertain Information

Autonomous attack decision-making of UCAV based on ABFCM model framework

A Kind of UCAV Attack Decision Arithmetic Based on Entropy of Avail Value

Air combat decision-making of multiple UCAVs based on constraint strategy games

Hybrid Game Theory and D-S Evidence Approach to Multiple UCAVs Cooperative Air Combat Decision.

Research on Air-to-ground Multi-target Sequential Attack Decision for Unmanned Combat Air Vehicle

UAV Air Combat Algorithm Based on Bayesian Probability Model

Cooperative task assignment algorithm of manned/unmanned aerial vehicle in uncertain environment

Robust Optimization based Air Combat Game Decision-making of Multi-UAV with Uncertain Information

Study on Mission Planning for UCAVs Attacking Time Constrained Targets

Research on UCAV Team Coordination Attack to Associated Targets Using Bayesian Optimization Algorithm

Study on UCAV Autonomous Air Combat Maneuvering Decision-Making

Cooperative Target Allocation for UCAV Team Air-to-Ground Attack Based on Decision Graph Bayesian Optimization Algorithm

Research on Method of Multiple UCAV Teams Attacking Multiple Ground Targets

Multiple UCAVs Cooperative Path Planning in Dynamic Environments

Research on Autonomous Maneuvering Decision of UCAV based on Approximate Dynamic Programming

Research on Unmanned Aerial Vehicle Cluster Collaborative Countermeasures Based on Dynamic Non-Zero-Sum Game under Asymmetric and Uncertain Information

A Rough Decision-making Model for UCAV Based on On-line Correction Time Series Forecasting Method

Harris' Hawk and Pigeon Inspired Attack-Defense Decision Making in Unmanned Combat Aerial Vehicles.

Air-combat decision-making for UAVs cooperatively attacking multiple targets