Abstract:Autonomous vehicles can reduce labor power during cargo transportation, and then improve transportation efficiency, for example, the automated guided vehicle (AGV) in the warehouse can improve the operation efficiency. To overcome the limitations of traditional path planning algorithms in unknown environments, such as reliance on high-precision maps, lack of generalization ability, and obstacle avoidance capability, this study focuses on investigating the Deep Q-Network and its derivative algorithm to enhance network and algorithm structures. A new algorithm named APF-D3QNPER is proposed, which combines the action output method of artificial potential field (APF) with the Dueling Double Deep Q Network algorithm, and experience sample rewards are considered in the experience playback portion of the traditional Deep Reinforcement Learning (DRL) algorithm, which enhances the convergence ability of the traditional DRL algorithm. A long short-term memory (LSTM) network is added to the state feature extraction network part to improve its adaptability in unknown environments and enhance its spatiotemporal sensitivity to the environment. The APF-D3QNPER algorithm is compared with mainstream deep reinforcement learning algorithms and traditional path planning algorithms using a robot operating system and the Gazebo simulation platform by conducting experiments. The results demonstrate that the APF-D3QNPER algorithm exhibits excellent generalization abilities in the simulation environment, and the convergence speed, the loss value, the path planning time, and the path planning length of the APF-D3QNPER algorithm are all less than for other algorithms in diverse scenarios.

Enhancing Offline Coverage Path Planning with Deep Reinforcement Learning

Learning-Based UAV Coverage-Aware Path Planning in Large-scale Urban Environments

Learning Coverage Paths in Unknown Environments with Deep Reinforcement Learning

UAV Coverage Path Planning Based on Deep Reinforcement Learning

Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular Decomposition

Improved Robot Path Planning Method Based on Deep Reinforcement Learning

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

Learning to Recharge: UAV Coverage Path Planning through Deep Reinforcement Learning

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

An Algorithm of Complete Coverage Path Planning for Unmanned Surface Vehicle Based on Reinforcement Learning

A Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Real-time local path planning strategy based on deep distributional reinforcement learning

An Indoor Blind Area-Oriented Autonomous Robotic Path Planning Approach Using Deep Reinforcement Learning

Adaptive Informative Path Planning Using Deep Reinforcement Learning for UAV-based Active Sensing

The Wide-Area Coverage Path Planning Strategy for Deep-Sea Mining Vehicle Cluster Based on Deep Reinforcement Learning

Deep Reinforcement Learning-based Collaborative Multi-UAV Coverage Path Planning

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Deep Reinforcement Learning for Mobile Robot Path Planning

LIRL: Latent Imagination-Based Reinforcement Learning for Efficient Coverage Path Planning