Abstract:This paper develops and evaluates the performance of an allocation agent to be potentially integrated into the onboard Detect and Avoid (DAA) computer of an Unmanned Aircraft System (UAS). We consider a UAS that can be fully controlled by the onboard DAA system and by a remote human pilot. With a communication channel prone to latency, we consider a mixed initiative interaction environment, where the control authority of the UAS is dynamically allocated by the allocation agent. In an encounter with a dynamic intruder, the probability of collision may increase in the absence of pilot commands in the presence of latency. Moreover, a delayed pilot command may not result in safe resolution of the current scenario and need to be improvised. We design an optimization algorithm to reduce collision risk and refine delayed pilot commands. Towards this end, a Markov Decision Process (MDP)and its solution are employed to create a wait time map. The map consists of estimated times that the UAS can wait for the remote pilot commands at each state. A command blending algorithm is designed to select an avoidance maneuver that prioritizes the pilot intention extracted from the pilot commands. The wait time map and the command blending algorithm are implemented and integrated into a closed-loop simulator. We conduct ten thousands fast-time Monte Carlo simulations and compare the performance of the integrated setup with a standalone DAA setup. The simulation results show that the allocation agent enables the UAS to wait without inducing any near mid air collision (NMAC) and severe loss of well clear (LoWC) while positively improve pilot involvement in the encounter resolution.

Autonomous Maneuver Decision for Unmanned Fighters in Multi-Agent BVR Air Combat

Manoeuvre Decision‐making of Unmanned Aerial Vehicles in Air Combat Based on an Expert Actor‐based Soft Actor Critic Algorithm

One-to-one Air-combat Maneuver Strategy Based on Improved TD3 Algorithm

Dual-UAVs Maneuvering Strategy Generation Algorithm Based on Cooperative Reward Mechanism and MATD3

The Optimal Strategies of Maneuver Decision in Air Combat of UCAV Based on the Improved TD3 Algorithm

Air Combat Autonomous Maneuver Decision for One-on-one Within Visual Range Engagement Base on Robust Multi-Agent Reinforcement Learning.

UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning

Autonomous attack decision-making of UCAV based on ABFCM model framework

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Generation Method of Autonomous Evasive Maneuver Strategy in Air Combat

Continuous Decision-making Method for Autonomous Air Combat

Maneuver Strategy Generation of UCAV for Within Visual Range Air Combat Based on Multi-Agent Reinforcement Learning and Target Position Prediction

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

One-to-one Close Air Combat Maneuver Decision Method Based on Target Maneuver Intention Prediction

BVR air combat decision making and simulation for UAV formation

Making Decisions on Proper Cooperation Tactics for Multiple Fighters to Combat from Beyond Visual Range (BVR) to Within Visual Range (WVR)

Autonomous Agent for Beyond Visual Range Air Combat: A Deep Reinforcement Learning Approach

Maneuver Decision of UAV in Short-Range Air Combat Based on Deep Reinforcement Learning

Dynamic Control Allocation between Onboard and Delayed Remote Control for Unmanned Aircraft System Detect-and-Avoid

Air Combat Maneuver Decision Method Based on A3C Deep Reinforcement Learning

Air Combat Maneuver Decision Based on Deep Reinforcement Learning and Game Theory