Abstract:Path planning algorithm has always been the core of intelligent robot research; a good path planning algorithm can significantly enhance the efficiency of robots in executing tasks. As the application scenarios for intelligent robots continue to diversify, their adaptability to the environment has become a key focus in current path planning algorithm research. As one of the classic reinforcement learning algorithms, Q-learning (QL) algorithm has its inherent advantages in adapting to the environment, but it also faces various challenges and shortcomings. These issues are primarily centered around suboptimal path planning, slow convergence speed, weak generalization capability and poor obstacle avoidance performance. In order to solve these issues in the QL algorithm, we have carried out the following work. (1) We redesign the reward mechanism of QL algorithm. The traditional Q-learning algorithm's reward mechanism is simple to implement but lacks directionality. We propose a combined reward mechanism of "static assignment + dynamic adjustment." This mechanism can address the issue of random path selection and ultimately lead to optimal path planning. (2) We redesign the greedy strategy of QL algorithm. In the traditional Q-learning algorithm, the greedy factor in the strategy is either randomly generated or set manually, which limits its applicability to some extent. It is difficult to effectively applied to different physical environments and scenarios, which is the fundamental reason for the poor generalization capability of the algorithm. We propose a dynamic adjustment of the greedy factor, known as the greedy strategy, which significantly improves the efficiency of Q-learning algorithm and enhances its generalization capability so that the algorithm has a wider range of application scenarios. (3) We introduce a concept to enhance the algorithm's obstacle avoidance performance. We design the expansion distance, which pre-sets a "collision buffer" between the obstacle and agent to enhance the algorithm's obstacle avoidance performance.

Multiple Suboptimal Policies Integrated Reinforcement Learning Algorithm for Path Planning

Successive Convex Approximation Based Off-Policy Optimization for Constrained Reinforcement Learning

Learning Hierarchical Graph-Based Policy for Goal-Reaching in Unknown Environments

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

An Incremental Optimization Approach to Address the Spatiotemporal Reward Coupling Effects in Deep Reinforcement Learning for Path Planning

Nearly Minimax Optimal Reward-free Reinforcement Learning.

Improved Robot Path Planning Method Based on Deep Reinforcement Learning

A Distributed Path Planning Algorithm via Reinforcement Learning

Asynchronous reinforcement learning algorithms for solving discrete space path planning problems

Planning with a Learned Policy Basis to Optimally Solve Complex Tasks

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Sub-optimal Policy Aided Multi-Agent Reinforcement Learning for Flocking Control

Mixed Reinforcement Learning for Efficient Policy Optimization in Stochastic Environments

Mobile Robot Path Planning Method Based on Deep Reinforcement Learning Algorithm

ETQ-learning: an improved Q-learning algorithm for path planning

Multi-Path Policy Optimization

Exploration in policy optimization through multiple paths

Multi-objective Path Planning Based on Deep Reinforcement Learning

Efficient Multi-agent Cooperative Navigation in Unknown Environments with Interlaced Deep Reinforcement Learning.