Abstract:Autonomous vehicles (AVs) have the potential to prevent accidents caused by drivers errors and reduce road traffic risks. Due to the nature of heavy vehicles, whose collisions cause more serious crashes, the weights of vehicles need to be considered when making driving strategies aimed at reducing the potential risks and their consequences in the context of autonomous driving. This study develops an autonomous driving strategy based on risk anticipation, considering the weights of surrounding vehicles and using hierarchical deep reinforcement learning. A risk indicator integrating surrounding vehicles weights, based on the risk field theory, is proposed and incorporated into autonomous driving decisions. A hybrid action space is designed to allow for left lane changes, right lane changes and car-following, which enables AVs to act more freely and realistically whenever possible. To solve the above hybrid decision-making problem, a hierarchical proximal policy optimization (HPPO) algorithm with an attention mechanism (AT-HPPO) is developed, providing great advantages in maintaining stable performance with high robustness and generalization. An indicator, potential collision energy in conflicts (PCEC), is newly proposed to evaluate the performance of the developed AV driving strategy from the perspective of the consequences of potential accidents. The performance evaluation results in simulation and dataset demonstrate that our model provides driving strategies that reduce both the likelihood and consequences of potential accidents, at the same time maintaining driving efficiency. The developed method is especially meaningful for AVs driving on highways, where heavy vehicles make up a high proportion of the traffic.

A Risk-Averse Preview-Based $Q$-Learning Algorithm: Application to Highway Driving of Autonomous Vehicles

Optimal reinforcement learning and probabilistic-risk-based path planning and following of autonomous vehicles with obstacle avoidance

Autonomous Highway Driving using Deep Reinforcement Learning

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers

An Efficient Risk-aware Branch MPC for Automated Driving that is Robust to Uncertain Vehicle Behaviors

Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learning

Amortized Q-learning with Model-based Action Proposals for Autonomous Driving on Highways

Hierarchical Learned Risk-Aware Planning Framework for Human Driving Modeling

RACP: Risk-Aware Contingency Planning with Multi-Modal Predictions

Risk in Stochastic and Robust Model Predictive Path-Following Control for Vehicular Motion Planning

QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving

Motion Planning of Vehicle Obstacle Avoidance by Quantum Reinforcement Learning

Risk-informed decision-making and control strategies for autonomous vehicles in emergency situations

A Learning-based Stochastic Driving Model for Autonomous Vehicle Testing

A Holistic Safe Planner for Automated Driving Considering Interaction with Human Drivers

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Long Horizon Risk-Averse Motion Planning: a Model-Predictive Approach

Safety-Assured Speculative Planning with Adaptive Prediction

Highway Exiting Planner for Automated Vehicles Using Reinforcement Learning

Building Safer Autonomous Agents by Leveraging Risky Driving Behavior Knowledge