Abstract:Path planning plays a vital role in autonomous driving as it needs to guide the vehicle to achieve the target position without collision while satisfying the vehicle's non-holonomic constraints. A good path planner should be able to cope with sophisticated environments and try to make the planned path as short as possible. Traditional path planning methods when being applied on four-wheel vehicles may suffer from one of the following disadvantages including conflicting with non-holonomic constraints, far from close-optimal length solution, or easy to get stuck in specific environments. In this paper, a hierarchical path planning method for a four-wheel vehicle combining probabilistic roadmap (PRM) and deep deterministic policy gradient (DDPG) is proposed to address existing problems. In the upper level, PRM is used to generate a guidance path quickly, which doesn't consider the vehicle's non-holonomic constraints but gives the sketch of the path that helps the vehicle to jump out of some dilemmas in specific environments while maintaining a relatively short path distance. In the lower level, reinforcement learning, specifically DDPG, is used to optimize the guidance path generated by PRM considering multiple factors including non-holonomic constraints and obstacle avoidance. The proposed method is validated in four different environments including a simple map, an easy-to-stuck specific map, a maze-like complex map and an office-like complex map. Results show that the proposed method could generate a smooth path satisfying non-holonomic constraints while demonstrating desirable obstacle avoidance performance. The planned path of the proposed method is superior to that of both traditional and state-of-the-art methods in terms of path length and smoothness, which could be 1.3%∼12.9% shorter and 2.6%∼52.1% smoother in different environments.

Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient

Learning Hierarchical Graph-Based Policy for Goal-Reaching in Unknown Environments

Mapless Path Planning for Mobile Robot Based on Improved Deep Deterministic Policy Gradient Algorithm

Multi-UAV Path Planning Based on Potential Field Dense Reward in Unknown Environments with Static and Dynamic Obstacles

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

An Improved DQN Algorithm for Automated Guided Vehicle Pathfinding Problem in Port Environment

Path Planning Algorithm in Complex Environment Based on DDPG and MPC

Deep Deterministic Policy Gradient Algorithm Based on Convolutional Block Attention for Autonomous Driving.

Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Prioritized experience replay in path planning via multi-dimensional transition priority fusion

Multi-Agent Path Planning based on MPC and DDPG

Hierarchical Path Planner Combining Probabilistic Roadmap and Deep Deterministic Policy Gradient for Unmanned Ground Vehicles with Non-Holonomic Constraints

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

SLP-Improved DDPG Path-Planning Algorithm for Mobile Robot in Large-Scale Dynamic Environment

Path Planning for Mobile Robot Based on Deep Reinforcement Learning with Double Experience Replay

Multiagent Motion Planning Based on Deep Reinforcement Learning in Complex Environments

Exploration- and Exploitation-Driven Deep Deterministic Policy Gradient for Active SLAM in Unknown Indoor Environments

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

Multi-Agent Path Planning Method Based on Improved Deep Q-Network in Dynamic Environments