Abstract:With the rapid development of Artificial Intelligence, AI-enabled Uncrewed Aerial Vehicles have garnered extensive attention since they offer an accessible and cost-effective solution for executing tasks in unknown or complex environments. However, developing secure and effective AI-based algorithms that empower agents to learn, adapt, and make precise decisions in dynamic situations continues to be an intriguing area of study. This paper proposes a hybrid intelligent control framework that integrates an enhanced Soft Actor–Critic method with a fuzzy inference system, incorporating pre-defined expert experience to streamline the learning process. Additionally, several practical algorithms and approaches within this control system are developed. With the synergy of these innovations, the proposed method achieves effective real-time path planning in unpredictable environments under a model-free setting. Crucially, it addresses two significant challenges in RL: dynamic-environment problems and multi-target problems. Diverse scenarios incorporating actual UAV dynamics were designed and simulated to validate the performance in tracking multiple mobile intruder aircraft. A comprehensive analysis and comparison of methods relying solely on RL and other influencing factors, as well as a controller feasibility assessment for real-world flight tests, are conducted, highlighting the advantages of the proposed hybrid architecture. Overall, this research advances the development of AI-driven approaches for UAV safe autonomous navigation under demanding airspace conditions and provides a viable learning-based control solution for different types of robots.

Flocking of Under-Actuated Unmanned Surface Vehicles via Deep Reinforcement Learning and Model Predictive Path Integral Control

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Cooperative Flocking And Learning In Multi-Robot Systems For Predator Avoidance

[Conservative therapy of fecal incontinence].

Deep Reinforcement Learning for Flocking Motion of Multi-UAV systems: Learn from a Digital Twin

Output-Feedback Flocking Control of Multiple Autonomous Surface Vehicles Based on Data-Driven Adaptive Extended State Observers

Control and Coordination of a SWARM of Unmanned Surface Vehicles using Deep Reinforcement Learning in ROS

USV Formation and Path-Following Control via Deep Reinforcement Learning With Random Braking

Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Adaptive neural formation control for underactuated unmanned surface vehicles with collision and connectivity constraints

Research on collision avoidance algorithm of unmanned surface vehicle based on deep reinforcement learning

Swarm control with collision avoidance for multiple underactuated surface vehicles

Adaptive Leader-Follower Formation Control and Obstacle Avoidance via Deep Reinforcement Learning

Three-Dimensional Leaderless Flocking Control Of Large-Scale Small Unmanned Aerial Vehicles

Data-Driven Performance-Prescribed Reinforcement Learning Control of an Unmanned Surface Vehicle

Leader–follower UAVs formation control based on a deep Q-network collaborative framework

PASCAL: PopulAtion-Specific Curriculum-based MADRL for collision-free flocking with large-scale fixed-wing UAV swarms

Deep Reinforcement Learning-Driven Collaborative Rounding-Up for Multiple Unmanned Aerial Vehicles in Obstacle Environments

Formation of Generic UAVs-USVs System Under Distributed Model Predictive Control Scheme

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

LSTM-DPPO based deep reinforcement learning controller for path following optimization of unmanned surface vehicle