Abstract:Transactions of the Institute of Measurement and Control, Ahead of Print. An offline and online bi-level structure-based dynamic path planning algorithm is proposed for an unmanned aerial vehicle (UAV) in low-altitude complex urban environment. First, an improved Hunger Games Search (HGS) algorithm is developed to generate an offline optimized path under the UAV's performance constraints and the known static obstacles' constraints. The individuals of the proposed algorithm will be divided into multiple groups to increase the population diversity. And then, a dynamic grouping strategy and a quantum-behaved behavior are proposed to solve the premature convergence's problem and the imbalance problem between exploration and exploitation ability in HGS. To improve the dynamic obstacle avoidance efficiency of the algorithm, the dynamic obstacles are classified into three categories: newly added no-fly zone, known and unknown dynamic obstacles. Then, utilizing the information of the offline optimized path and the airborne sensors, three kinds of online planning strategies—an improved rapid-exploring random tree (RRT), a changing speed strategy, and a novel three-dimensional rolling windows—are introduced to dynamically update the path or speed of the UAV. Simulation results indicated that the improved HGS can enhance the performances of the traditional HGS and outperform other compared algorithms on the benchmark functions. Meanwhile, the online planning strategies can effectively achieve dynamic obstacle avoidance within the constraints of offline path. More specially, the planning time and angles of the local path to avoid the no-fly-zone's influence are improved by 11.3% and 56.8% through utilizing the improved RRT.

An Adaptive Conversion Speed Q-Learning Algorithm for Search and Rescue UAV Path Planning in Unknown Environments

A Modified Q-learning Algorithm Facing for Path Planning and Obstacle Avoidance Method for Unmanned Aerial Vehicle

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

Optimizing Search and Rescue UAV Connectivity in Challenging Terrain through Multi Q-Learning

Reinforcement Learning-Based Low-Altitude Path Planning for UAS Swarm in Diverse Threat Environments

A novel UAV path planning approach: Heuristic crossing search and rescue optimization algorithm

An Adaptive Q-learning Based Particle Swarm Optimization for Multi-Uav Path Planning

Route Planning Method for UAV in Unknown Environment Based on Improved SAS Algorithm

Research on UAV Coverage Search Based on DDQN in Unknown Environments

Q Learning Algorithm Based UAV Path Learning and Obstacle Avoidence Approach

A Reinforcement Learning-Based Evolutionary Algorithm for the Unmanned Aerial Vehicles Maritime Search and Rescue Path Planning Problem Considering Multiple Rescue Centers

A path planning approach for unmanned surface vehicles based on dynamic and fast Q-learning

Bi-level intelligent dynamic path planning for an UAV in low-altitude complex urban environment

Research on Path Planning in UAV-assisted Emergency Communication

Enhanced Multi-UAV Path Planning in Complex Environments With Voronoi-Based Obstacle Modelling and Q-Learning

Path Planning of Unmanned Aerial Vehicle in Complex Environments Based on State-Detection Twin Delayed Deep Deterministic Policy Gradient

Ucav Path Planning Algorithm Based On Deep Reinforcement Learning

Reinforcement-learning-based path planning for UAVs in intensive obstacle environment

Path Planning Research of a UAV Base Station Searching for Disaster Victims' Location Information Based on Deep Reinforcement Learning

Solving reward-collecting problems with UAVs: a comparison of online optimization and Q-learning

Efficient and High Path Quality Autonomous Exploration and Trajectory Planning of UAV in an Unknown Environment