Abstract:Path planning plays a vital role in autonomous driving as it needs to guide the vehicle to achieve the target position without collision while satisfying the vehicle's non-holonomic constraints. A good path planner should be able to cope with sophisticated environments and try to make the planned path as short as possible. Traditional path planning methods when being applied on four-wheel vehicles may suffer from one of the following disadvantages including conflicting with non-holonomic constraints, far from close-optimal length solution, or easy to get stuck in specific environments. In this paper, a hierarchical path planning method for a four-wheel vehicle combining probabilistic roadmap (PRM) and deep deterministic policy gradient (DDPG) is proposed to address existing problems. In the upper level, PRM is used to generate a guidance path quickly, which doesn't consider the vehicle's non-holonomic constraints but gives the sketch of the path that helps the vehicle to jump out of some dilemmas in specific environments while maintaining a relatively short path distance. In the lower level, reinforcement learning, specifically DDPG, is used to optimize the guidance path generated by PRM considering multiple factors including non-holonomic constraints and obstacle avoidance. The proposed method is validated in four different environments including a simple map, an easy-to-stuck specific map, a maze-like complex map and an office-like complex map. Results show that the proposed method could generate a smooth path satisfying non-holonomic constraints while demonstrating desirable obstacle avoidance performance. The planned path of the proposed method is superior to that of both traditional and state-of-the-art methods in terms of path length and smoothness, which could be 1.3%∼12.9% shorter and 2.6%∼52.1% smoother in different environments.

3D Environment-based Multiobjective Path Planning for Unmanned Ground Vehicles.

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

Deep Reinforcement Learning-based Multi-objective Path Planning on the Off-road Terrain Environment for Ground Vehicles

Hierarchical Path Planner Combining Probabilistic Roadmap and Deep Deterministic Policy Gradient for Unmanned Ground Vehicles with Non-Holonomic Constraints

Unmanned Aerial Vehicle Path Planning Algorithm Based on Deep Reinforcement Learning in Large-Scale and Dynamic Environments

Deep Reinforcement Learning-Based 2.5D Multi-Objective Path Planning for Ground Vehicles: Considering Distance and Energy Consumption

Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning

Three-dimensional Path Planning for Unmanned Ground Vehicles in Complex Building Environments

Pursuit Path Planning for Multiple Unmanned Ground Vehicles Based on Deep Reinforcement Learning

Multi-objective Path Planning Based on Deep Reinforcement Learning

Three-Dimensional Path Planning of UAVs in a Complex Dynamic Environment Based on Environment Exploration Twin Delayed Deep Deterministic Policy Gradient.

Path Planning and Optimization of Unmanned Ground Vehicles (ugvs) in the Field

Unmanned Vehicle Path Planning for Unknown Off-road Environments with Sparse Waypoints

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

Integrated Path Planning for Unmanned Differential Steering Vehicles in Off-Road Environment With 3D Terrains and Obstacles

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning

Multi-Agent Path Planning Method Based on Improved Deep Q-Network in Dynamic Environments

Path Planning Method Using Dyna-Q Algorithm under Complex Urban Environment

Path planning for unmanned ground vehicle based on fuzzy obstacles environment model

A Global Path Planning Method for Unmanned Ground Vehicles in Off-Road Environments Based on Mobility Prediction

Autonomous Navigation of UAV in Multi-Obstacle Environments Based on a Deep Reinforcement Learning Approach