Abstract:Rule-based traditional motion planning methods usually perform well with prior knowledge of the macro-scale environments but encounter challenges in unknown and uncertain environments. Deep reinforcement learning (DRL) is a solution that can effectively deal with micro-scale unknown and uncertain environments. Nevertheless, DRL is unstable and lacks interpretability. Therefore, it raises a new challenge: how to combine the effectiveness and overcome the drawbacks of the two methods while guaranteeing stability in uncertain environments. In this study, a multi-constraint and multi-scale motion planning method is proposed for automated driving with the use of constrained reinforcement learning (RL), named RLTT, and comprising RL, a topological reachability analysis used for vehicle path space (TPS), and a trajectory lane model (TLM). First, a dynamic model of vehicles is formulated; then, TLM is developed on the basis of the dynamic model, thus constraining RL action and state space. Second, macro-scale path planning is achieved through TPS, and in the micro-scale range, discrete routing points are achieved via RLTT. Third, the proposed motion planning method is designed by combining sophisticated rules, and a theoretical analysis is provided to guarantee the efficiency of our method. Finally, related experiments are conducted to evaluate the effectiveness of the proposed method; our method can reduce 19.9% of the distance cost in the experiments as compared to the traditional method. Experimental results indicate that the proposed method can help mitigate the gap between data-driven and traditional methods, provide better performance for automated driving, and facilitate the use of RL methods in more fields.

Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios

Constrained Reinforcement Learning for Vehicle Motion Planning with Topological Reachability Analysis

Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

A Reinforcement Learning-Boosted Motion Planning Framework: Comprehensive Generalization Performance in Autonomous Driving

Reinforcement Learning Based Trajectory Planning for Autonomous Vehicles

Let Hybrid A* Path Planner Obey Traffic Rules: A Deep Reinforcement Learning-Based Planning Framework

Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

An efficient planning method based on deep reinforcement learning with hybrid actions for autonomous driving on highway

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

Safe Trajectory Planning Using Reinforcement Learning for Self Driving

Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

Receding-Horizon Reinforcement Learning Approach for Kinodynamic Motion Planning of Autonomous Vehicles

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving

A Hybrid Motion Planning Framework for Autonomous Driving in Mixed Traffic Flow

Highway Decision-Making and Motion Planning for Autonomous Driving via Soft Actor-Critic

An End-to-end Deep Reinforcement Learning Approach for the Long-term Short-term Planning on the Frenet Space

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning