Abstract:Path planning algorithm has always been the core of intelligent robot research; a good path planning algorithm can significantly enhance the efficiency of robots in executing tasks. As the application scenarios for intelligent robots continue to diversify, their adaptability to the environment has become a key focus in current path planning algorithm research. As one of the classic reinforcement learning algorithms, Q-learning (QL) algorithm has its inherent advantages in adapting to the environment, but it also faces various challenges and shortcomings. These issues are primarily centered around suboptimal path planning, slow convergence speed, weak generalization capability and poor obstacle avoidance performance. In order to solve these issues in the QL algorithm, we have carried out the following work. (1) We redesign the reward mechanism of QL algorithm. The traditional Q-learning algorithm's reward mechanism is simple to implement but lacks directionality. We propose a combined reward mechanism of "static assignment + dynamic adjustment." This mechanism can address the issue of random path selection and ultimately lead to optimal path planning. (2) We redesign the greedy strategy of QL algorithm. In the traditional Q-learning algorithm, the greedy factor in the strategy is either randomly generated or set manually, which limits its applicability to some extent. It is difficult to effectively applied to different physical environments and scenarios, which is the fundamental reason for the poor generalization capability of the algorithm. We propose a dynamic adjustment of the greedy factor, known as the greedy strategy, which significantly improves the efficiency of Q-learning algorithm and enhances its generalization capability so that the algorithm has a wider range of application scenarios. (3) We introduce a concept to enhance the algorithm's obstacle avoidance performance. We design the expansion distance, which pre-sets a "collision buffer" between the obstacle and agent to enhance the algorithm's obstacle avoidance performance.

Reinforcement learning path planning algorithm based on obstacle area expansion strategy

A Modified Q-learning Algorithm Facing for Path Planning and Obstacle Avoidance Method for Unmanned Aerial Vehicle

ETQ-learning: an improved Q-learning algorithm for path planning

An Adaptive Exploratory Q-Learning Algorithm for Multiple Target Path Planning.

Biologically Inspired Complete Coverage Path Planning Algorithm Based on Q-Learning

Local Path Planning Via Improved Fuzzy and Q(λ)-learning Algorithms for the Mobile Robot

Study On Adaptive Path Planning For Mobile Robot Based On Q Learning

An optimized Q-Learning algorithm for mobile robot local path planning

Reinforcement-learning-based path planning for UAVs in intensive obstacle environment

Enhanced Multi-UAV Path Planning in Complex Environments With Voronoi-Based Obstacle Modelling and Q-Learning

Agent Maze Path Planning Based on Simulated Annealing Q-Learning Algorithm

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Three-dimensional Collaborative Path Planning for Multiple UCAVs Based on Improved Artificial Ecosystem Optimizer and Reinforcement Learning

An Improved Dyna-Q Algorithm for Mobile Robot Path Planning in Unknown Dynamic Environment

Improved Q -Learning Method for Multirobot Formation and Path Planning with Concave Obstacles

A novel Q-learning algorithm based on improved whale optimization algorithm for path planning

Q Learning Algorithm Based UAV Path Learning and Obstacle Avoidence Approach

A Game-Learning-Based Smooth Path Planning Strategy for Intelligent Air–Ground Vehicle Considering Mode Switching

Q-Learning Based Method Of Adaptive Path Planning For Mobile Robot

Robot path planner based on deep reinforcement learning and the seeker optimization algorithm

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments