Abstract:Path planning plays a vital role in autonomous driving as it needs to guide the vehicle to achieve the target position without collision while satisfying the vehicle's non-holonomic constraints. A good path planner should be able to cope with sophisticated environments and try to make the planned path as short as possible. Traditional path planning methods when being applied on four-wheel vehicles may suffer from one of the following disadvantages including conflicting with non-holonomic constraints, far from close-optimal length solution, or easy to get stuck in specific environments. In this paper, a hierarchical path planning method for a four-wheel vehicle combining probabilistic roadmap (PRM) and deep deterministic policy gradient (DDPG) is proposed to address existing problems. In the upper level, PRM is used to generate a guidance path quickly, which doesn't consider the vehicle's non-holonomic constraints but gives the sketch of the path that helps the vehicle to jump out of some dilemmas in specific environments while maintaining a relatively short path distance. In the lower level, reinforcement learning, specifically DDPG, is used to optimize the guidance path generated by PRM considering multiple factors including non-holonomic constraints and obstacle avoidance. The proposed method is validated in four different environments including a simple map, an easy-to-stuck specific map, a maze-like complex map and an office-like complex map. Results show that the proposed method could generate a smooth path satisfying non-holonomic constraints while demonstrating desirable obstacle avoidance performance. The planned path of the proposed method is superior to that of both traditional and state-of-the-art methods in terms of path length and smoothness, which could be 1.3%∼12.9% shorter and 2.6%∼52.1% smoother in different environments.

Deep Reinforcement Learning-based Off-road Path Planning Via Low-dimensional Simulation

Deep Reinforcement Learning-based Multi-objective Path Planning on the Off-road Terrain Environment for Ground Vehicles

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

Deep Reinforcement Learning-Based 2.5D Multi-Objective Path Planning for Ground Vehicles: Considering Distance and Energy Consumption

Unmanned Aerial Vehicle Path Planning Algorithm Based on Deep Reinforcement Learning in Large-Scale and Dynamic Environments

WROOM: An Autonomous Driving Approach for Off-Road Navigation

Safety-guided Deep Reinforcement Learning for Path Planning of Autonomous Mobile Robots

DDPG-Based Path Planning Approach for Autonomous Driving

Enhancing Offline Coverage Path Planning with Deep Reinforcement Learning

3D Environment-based Multiobjective Path Planning for Unmanned Ground Vehicles.

A Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

Unmanned Vehicle Path Planning for Unknown Off-road Environments with Sparse Waypoints

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Hierarchical Path Planner Combining Probabilistic Roadmap and Deep Deterministic Policy Gradient for Unmanned Ground Vehicles with Non-Holonomic Constraints

Real-time local path planning strategy based on deep distributional reinforcement learning

Research on Game-Playing Agents Based on Deep Reinforcement Learning.

Visual Local Path Planning Based on Deep Reinforcement Learning

A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

An End-to-End Deep Reinforcement Learning Model Based on Proximal Policy Optimization Algorithm for Autonomous Driving of Off-Road Vehicle