Abstract:With the rapid development of Artificial Intelligence, AI-enabled Uncrewed Aerial Vehicles have garnered extensive attention since they offer an accessible and cost-effective solution for executing tasks in unknown or complex environments. However, developing secure and effective AI-based algorithms that empower agents to learn, adapt, and make precise decisions in dynamic situations continues to be an intriguing area of study. This paper proposes a hybrid intelligent control framework that integrates an enhanced Soft Actor–Critic method with a fuzzy inference system, incorporating pre-defined expert experience to streamline the learning process. Additionally, several practical algorithms and approaches within this control system are developed. With the synergy of these innovations, the proposed method achieves effective real-time path planning in unpredictable environments under a model-free setting. Crucially, it addresses two significant challenges in RL: dynamic-environment problems and multi-target problems. Diverse scenarios incorporating actual UAV dynamics were designed and simulated to validate the performance in tracking multiple mobile intruder aircraft. A comprehensive analysis and comparison of methods relying solely on RL and other influencing factors, as well as a controller feasibility assessment for real-world flight tests, are conducted, highlighting the advantages of the proposed hybrid architecture. Overall, this research advances the development of AI-driven approaches for UAV safe autonomous navigation under demanding airspace conditions and provides a viable learning-based control solution for different types of robots.

Variable Admittance Interaction Control of UAVs via Deep Reinforcement Learning

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Adaptive collision-free control for UAVs with discrete-time system based on reinforcement learning

Control of UAV Quadrotor Using Reinforcement Learning and Robust Controller

Application of Deep Reinforcement Learning in UAVs: A Review

Reinforcement Learning for UAV Attitude Control

Deep Reinforcement Learning With Application to Air Confrontation Intelligent Decision-Making of Manned/Unmanned Aerial Vehicle Cooperative System

Responsive Regulation of Dynamic UAV Communication Networks Based on Deep Reinforcement Learning

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Supplementary Reinforcement Learning Controller Designed for Quadrotor UAVs.

Event-triggered Reinforcement Learning Control for the Quadrotor UAV with Actuator Saturation

Deep Reinforcement Learning-Based End-to-End Control for UAV Dynamic Target Tracking

Reinforced Learning-Based Robust Control Design for Unmanned Aerial Vehicle

Realizing asynchronous finite-time robust tracking control of switched flight vehicles by using nonfragile deep reinforcement learning

Online Safe Flight Control Method Based on Constraint Reinforcement Learning

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

Intercepting Unauthorized Aerial Robots in Controlled Airspace Using Reinforcement Learning

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking