Abstract:Autonomous vehicles (AVs) have the potential to prevent accidents caused by drivers errors and reduce road traffic risks. Due to the nature of heavy vehicles, whose collisions cause more serious crashes, the weights of vehicles need to be considered when making driving strategies aimed at reducing the potential risks and their consequences in the context of autonomous driving. This study develops an autonomous driving strategy based on risk anticipation, considering the weights of surrounding vehicles and using hierarchical deep reinforcement learning. A risk indicator integrating surrounding vehicles weights, based on the risk field theory, is proposed and incorporated into autonomous driving decisions. A hybrid action space is designed to allow for left lane changes, right lane changes and car-following, which enables AVs to act more freely and realistically whenever possible. To solve the above hybrid decision-making problem, a hierarchical proximal policy optimization (HPPO) algorithm with an attention mechanism (AT-HPPO) is developed, providing great advantages in maintaining stable performance with high robustness and generalization. An indicator, potential collision energy in conflicts (PCEC), is newly proposed to evaluate the performance of the developed AV driving strategy from the perspective of the consequences of potential accidents. The performance evaluation results in simulation and dataset demonstrate that our model provides driving strategies that reduce both the likelihood and consequences of potential accidents, at the same time maintaining driving efficiency. The developed method is especially meaningful for AVs driving on highways, where heavy vehicles make up a high proportion of the traffic.

Probabilistic Lane-Change Decision-Making and Planning for Autonomous Heavy Vehicles

A Dynamic Trajectory Planning Method for Lane-Changing Maneuver of Connected and Automated Vehicles

A Lane Changing Time Point and Path Tracking Framework for Autonomous Ground Vehicle

Research on Lane-Change Decision and Planning in Multilane Expressway Scenarios for Autonomous Vehicles

A lane-changing trajectory re-planning method considering conflicting traffic scenarios

Personalized Trajectory Planning and Control of Lane-Change Maneuvers for Autonomous Driving.

Dynamic Lane-Changing Trajectory Planning for Autonomous Vehicles Based on Discrete Global Trajectory

A Novel Lane-Change Decision-Making With Long-Time Trajectory Prediction for Autonomous Vehicle

Research on lane-changing decision and control of autonomous vehicles based on game theory

Driver's Individual Risk Perception-Based Trajectory Planning: A Human-Like Method

Manoeuvre Prediction and Planning for Automated and Connected Vehicles Based on Interaction and Gaming Awareness under Uncertainty

Multi-vehicle dynamic interaction in autonomous driving: integrating game theory and the potential field method

Game-Theoretic Lane Change Decision-Making Method Considering Traffic Trend

Uncertainty-aware Decision Making and Planning for ICV Based on Asymmetric Driving Aggressiveness

Probabilistic Vehicle Trajectory Prediction Via Driver Characteristic and Intention Estimation Model under Uncertainty

Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning

Research on Lane Changing Game and Behavioral Decision Making Based on Driving Styles and Micro-Interaction Behaviors

An Integrated Decision and Motion Planning Framework for Automated Driving on Highway

Humanlike Decision and Motion Planning for Expressway Lane Changing Based on Artificial Potential Field

Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learning

Toward Safe and Personalized Autonomous Driving: Decision-Making and Motion Control With DPF and CDT Techniques