Abstract:With the rapid development of Artificial Intelligence, AI-enabled Uncrewed Aerial Vehicles have garnered extensive attention since they offer an accessible and cost-effective solution for executing tasks in unknown or complex environments. However, developing secure and effective AI-based algorithms that empower agents to learn, adapt, and make precise decisions in dynamic situations continues to be an intriguing area of study. This paper proposes a hybrid intelligent control framework that integrates an enhanced Soft Actor–Critic method with a fuzzy inference system, incorporating pre-defined expert experience to streamline the learning process. Additionally, several practical algorithms and approaches within this control system are developed. With the synergy of these innovations, the proposed method achieves effective real-time path planning in unpredictable environments under a model-free setting. Crucially, it addresses two significant challenges in RL: dynamic-environment problems and multi-target problems. Diverse scenarios incorporating actual UAV dynamics were designed and simulated to validate the performance in tracking multiple mobile intruder aircraft. A comprehensive analysis and comparison of methods relying solely on RL and other influencing factors, as well as a controller feasibility assessment for real-world flight tests, are conducted, highlighting the advantages of the proposed hybrid architecture. Overall, this research advances the development of AI-driven approaches for UAV safe autonomous navigation under demanding airspace conditions and provides a viable learning-based control solution for different types of robots.

Deep Reinforcement Learning Based Systems for Safety Critical Applications in Aerospace

Safe and Reliable Training of Learning-Based Aerospace Controllers

Deep Reinforcement Learning With Application to Air Confrontation Intelligent Decision-Making of Manned/Unmanned Aerial Vehicle Cooperative System

An Aircraft Collision Avoidance Method Based on Deep Reinforcement Learning

Application of Deep Reinforcement Learning in UAVs: A Review

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Hierarchical Reinforcement Learning for Air-to-Air Combat

Safety, Trust, and Ethics Considerations for Human-AI Teaming in Aerospace Control

Reinforcement Learning-based Optimal Control and Software Rejuvenation for Safe and Efficient UAV Navigation

Intelligent Control of Aeroengines Based on Safe Deep Reinforcement Learning

Safety Enhancement for Deep Reinforcement Learning in Autonomous Separation Assurance

Optimizing Collision Avoidance in Dense Airspace using Deep Reinforcement Learning

Deep RL for Autonomous Robots: Limitations and Safety Challenges.

Deep Reinforcement Learning for Autonomous Driving Systems

Deep Reinforcement Learning Based Conflict Detection and Resolution in Air Traffic Control

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

Safe Spacecraft Inspection via Deep Reinforcement Learning and Discrete Control Barrier Functions

Drone Deep Reinforcement Learning: A Review

A Domain-Knowledge-Aided Deep Reinforcement Learning Approach for Flight Control Design

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving