Abstract:A deep reinforcement Q learning algorithm (DRQN) based on radial neural network is proposed to achieve path planning and obstacle avoidance for mobile robots in complex ground environments with different types of obstacles, including static and dynamic obstacles. Firstly, the path planning problem is represented as a partially-observed Markov decision process. Steering angle, running characteristics, and other elements are introduced into the state-action decision space and the greedy factor is dynamically adjusted using a simulated annealing algorithm, which improves the mobile robot's environment exploration and action selection accuracy. Secondly, the Q-learning algorithm is improved by replacing the Q-table structure with an RBF neural network to enhance the approximation ability of the algorithm's function values, and the parameters of the implicit layer and the weights between the implicit and the output layer are trained using the dynamic clustering and least-mean methods respectively, which improves the convergence speed and enhances the ability of mobile robots to handle large-scale computation. Lastly, the double reward mechanism is set up to prevent the mobile robot from blind searching in unknown environments, which enhances the learning ability and improves path planning safety and flexibility at the same time. Different types of scenarios are set up for simulation experiments, and the results verified the superiority of the DQRN algorithm. Taking the 30 * 30 complex scene as an example, using the DQRN algorithm for path planning reduces the values of distance, turning angle, and planning time by 27.04%, 7.76%, and 28.05%, respectively, compared to the average values of Q-learning, optimized Q-learning, deep Q-learning, and DDPG algorithms, which can effectively improve the path planning efficiency for mobile robots in complex environments.

A Path-Planning Approach Based on Potential and Dynamic Q-Learning for Mobile Robots in Unknown Environment

New Path Planner for Mobile Robot in Dynamic Unkown Environment

Real-Time Path Planning for Mobile Robots

A path planning approach for mobile robots using short and safe Q-learning.

On-line Real-Time Path Planning of Mobile Robots in Dynamic Uncertain Environment

Reinforcement based mobile robot path planning with improved dynamic window approach in unknown environment

Dynamic path planning of mobile robots using adaptive dynamic programming

A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

An optimized Q-Learning algorithm for mobile robot local path planning

Real-Time Dynamic Path Planning of Mobile Robots: A Novel Hybrid Heuristic Optimization Algorithm

Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning

Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Research on mobile robot path planning in complex environment based on DRQN algorithm

A path planning approach for unmanned surface vehicles based on dynamic and fast Q-learning

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

Mobile Robot Path Planning Using a QAPF Learning Algorithm for Known and Unknown Environments

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Integrating Deep Reinforcement Learning and Improved Artificial Potential Field Method for Safe Path Planning for Mobile Robots

Path Planning Method With Improved Artificial Potential Field—A Reinforcement Learning Perspective