Abstract:This paper presents a robust satisficing decision-making method for Unmanned Aerial Vehicles (UAVs) executing complex missions in an uncertain environment. Motivated by the info-gap decision theory, we formulate this problem as a novel robust satisficing optimization problem, of which the objective is to maximize the robustness while satisfying some desired mission requirements. Specifically, a new info-gap based Markov Decision Process (IMDP) is constructed to abstract the uncertain UAV system and specify the complex mission requirements with the Linear Temporal Logic (LTL). A robust satisficing policy is obtained to maximize the robustness to the uncertain IMDP while ensuring a desired probability of satisfying the LTL specifications. To this end, we propose a two-stage robust satisficing solution strategy which consists of the construction of a product IMDP and the generation of a robust satisficing policy. In the first stage, a product IMDP is constructed by combining the IMDP with an automaton representing the LTL specifications. In the second, an algorithm based on robust dynamic programming is proposed to generate a robust satisficing policy, while an associated robustness evaluation algorithm is presented to evaluate the robustness. Finally, through Monte Carlo simulation, the effectiveness of our algorithms is demonstrated on an UAV search mission under severe uncertainty so that the resulting policy can maximize the robustness while reaching the desired performance level. Furthermore, by comparing the proposed method with other robust decision-making methods, it can be concluded that our policy can tolerate higher uncertainty so that the desired performance level can be guaranteed, which indicates that the proposed method is much more effective in real applications.

Robust Optimization based Air Combat Game Decision-making of Multi-UAV with Uncertain Information

Multi-UAV Counter-Game Model Based on Uncertain Information

Cooperative Maneuver Decision Making for Multi-Uav Air Combat Based on Incomplete Information Dynamic Game

Inhomogeneous Multi-Uav Aerial Base Stations Deployment: A Mean-Field-Type Game Approach

Robust Satisficing Decision Making for Unmanned Aerial Vehicle Complex Missions under Severe Uncertainty

Cooperative task assignment algorithm of manned/unmanned aerial vehicle in uncertain environment

Decision-making of Multi-Uav Combat Game Via Enhanced Competitive Learning Pigeon-Inspired Optimization

Air combat decision-making of multiple UCAVs based on constraint strategy games

Optimal Allocation of Aerial Target Detection and Attack in Cooperative Multi-fighter Air Combat

Optimal confrontation position selecting games model and its application to one-on-one air combat

Study on Optimal Robust Control for Multiple UAVs' Collaborative Formation Flight

Air Combat Maneuver Decision Based on Deep Reinforcement Learning and Game Theory

Hybrid Game Theory and D-S Evidence Approach to Multiple UCAVs Cooperative Air Combat Decision.

A Robust Optimization Model For Project Portfolio Selection With Information Uncertainty

High-Fidelity Decision-Making and Simulation for Cooperative Autonomous Air Combat Considering the Effect of Flight Controller

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

Research on Unmanned Aerial Vehicle Cluster Collaborative Countermeasures Based on Dynamic Non-Zero-Sum Game under Asymmetric and Uncertain Information

Optimizing Underwater Game Strategy Based on Cooperative Confrontation

Game Decision of Multi-UAV Based on Improved Shark Smell Optimization Algorithm

Research on the Optimization Model for Target Assignment of Multiple UAVs Based on Probability Equilibrium Strategy

Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic