Abstract:Autonomous vehicles can reduce labor power during cargo transportation, and then improve transportation efficiency, for example, the automated guided vehicle (AGV) in the warehouse can improve the operation efficiency. To overcome the limitations of traditional path planning algorithms in unknown environments, such as reliance on high-precision maps, lack of generalization ability, and obstacle avoidance capability, this study focuses on investigating the Deep Q-Network and its derivative algorithm to enhance network and algorithm structures. A new algorithm named APF-D3QNPER is proposed, which combines the action output method of artificial potential field (APF) with the Dueling Double Deep Q Network algorithm, and experience sample rewards are considered in the experience playback portion of the traditional Deep Reinforcement Learning (DRL) algorithm, which enhances the convergence ability of the traditional DRL algorithm. A long short-term memory (LSTM) network is added to the state feature extraction network part to improve its adaptability in unknown environments and enhance its spatiotemporal sensitivity to the environment. The APF-D3QNPER algorithm is compared with mainstream deep reinforcement learning algorithms and traditional path planning algorithms using a robot operating system and the Gazebo simulation platform by conducting experiments. The results demonstrate that the APF-D3QNPER algorithm exhibits excellent generalization abilities in the simulation environment, and the convergence speed, the loss value, the path planning time, and the path planning length of the APF-D3QNPER algorithm are all less than for other algorithms in diverse scenarios.

Path Planning Using Deep Reinforcement Learning Based on Potential Field in Complex Environment

Path Planning of Mobile Robot Based on Deep Reinforcement Learning and Improved Artificial Potential Field

Path Planning Method With Improved Artificial Potential Field—A Reinforcement Learning Perspective

An End-to-End Path Planner Combining Potential Field Method With Deep Reinforcement Learning

Multi-UAV Path Planning Based on Potential Field Dense Reward in Unknown Environments with Static and Dynamic Obstacles

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning

Integrating Deep Reinforcement Learning and Improved Artificial Potential Field Method for Safe Path Planning for Mobile Robots

A Path-Planning Approach Based on Potential and Dynamic Q-Learning for Mobile Robots in Unknown Environment

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

Path Planning Optimization Based on Reinforcement of Artificial Potential Field

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

Research on path planning of robot based on deep reinforcement learning

Multi-Robot Motion Planning: A Learning-Based Artificial Potential Field Solution

Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Robot Path Planning in Dynamic Environments Based on Deep Reinforcement Learning

Safety-guided Deep Reinforcement Learning for Path Planning of Autonomous Mobile Robots

Reinforced Potential Field for Multi-Robot Motion Planning in Cluttered Environments

DDPG-Based Path Planning Approach for Autonomous Driving