Abstract:Autonomous vehicles (AVs) have the potential to prevent accidents caused by drivers errors and reduce road traffic risks. Due to the nature of heavy vehicles, whose collisions cause more serious crashes, the weights of vehicles need to be considered when making driving strategies aimed at reducing the potential risks and their consequences in the context of autonomous driving. This study develops an autonomous driving strategy based on risk anticipation, considering the weights of surrounding vehicles and using hierarchical deep reinforcement learning. A risk indicator integrating surrounding vehicles weights, based on the risk field theory, is proposed and incorporated into autonomous driving decisions. A hybrid action space is designed to allow for left lane changes, right lane changes and car-following, which enables AVs to act more freely and realistically whenever possible. To solve the above hybrid decision-making problem, a hierarchical proximal policy optimization (HPPO) algorithm with an attention mechanism (AT-HPPO) is developed, providing great advantages in maintaining stable performance with high robustness and generalization. An indicator, potential collision energy in conflicts (PCEC), is newly proposed to evaluate the performance of the developed AV driving strategy from the perspective of the consequences of potential accidents. The performance evaluation results in simulation and dataset demonstrate that our model provides driving strategies that reduce both the likelihood and consequences of potential accidents, at the same time maintaining driving efficiency. The developed method is especially meaningful for AVs driving on highways, where heavy vehicles make up a high proportion of the traffic.

Risk Assessment and Interactive Motion Planning with Visual Occlusion Using Graph Attention Networks and Reinforcement Learning

Drive with Quantified Risk: A Probabilistic Approach for Occlusion-Aware Trajectory Planning

Cross-Observability Optimistic-Pessimistic Safe Reinforcement Learning for Interactive Motion Planning with Visual Occlusion

Autonomous Vehicles' Turning Motion Planning for Conflict Areas at Mixed-Flow Intersections.

RiskMap: A Unified Driving Context Representation for Autonomous Motion Planning in Urban Driving Environment

An Uncertainty-Aware Lane Change Motion Planning Algorithm Based on Probabilistic Trajectory Prediction Distribution

Risk-Aware Neural Navigation From BEV Input for Interactive Driving

Occlusion-aware collision avoidance trajectory planning with potential collision risk assessment for autonomous vehicle

Overcoming the Fear of the Dark: Occlusion-Aware Model-Predictive Planning for Automated Vehicles Using Risk Fields

Towards Safe Motion Planning for Autonomous Driving in Highway

Risk-Aware Decision-Making and Planning Using Prediction-Guided Strategy Tree for the Uncontrolled Intersections

Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learning

Risk-aware Deep Reinforcement Learning for Decision-making and Planning of Autonomous Vehicles

Manoeuvre Prediction and Planning for Automated and Connected Vehicles Based on Interaction and Gaming Awareness under Uncertainty

Surrounding Vehicles Motion Prediction for Risk Assessment and Motion Planning of Autonomous Vehicle in Highway Scenarios

Occlusion-Aware Risk Assessment for Autonomous Driving in Urban Environments

Occlusion-aware Risk Assessment and Driving Strategy for Autonomous Vehicles Using Simplified Reachability Quantification

Motion Planning for Autonomous Vehicles in Uncertain Environments Using Hierarchical Distributional Reinforcement Learning

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

Motion Planning for Connected Automated Vehicles at Occluded Intersections With Infrastructure Sensors

A probabilistic risk assessment framework considering lane-changing behavior interaction