Abstract:Reinforcement learning (RL) methods are commonly regarded as effective solutions for designing intelligent driving policies. Nonetheless, even if the RL policy is converged after training, it is notoriously difficult to ensure safety. In particular, RL policy is susceptible to insecurity in the presence of long-tail or unseen traffic scenarios, i.e., out-of-distribution test data. Therefore, the design of the RL-based decision-making method must account for this shift in distribution. This paper proposes a robust decision-making framework for autonomous driving on the highway to improve driving safety. First, a Deep Deterministic Policy Gradient (DDPG)-based RL policy that directly maps observations to actions is constructed. Subsequently, the model uncertainty of the DDPG policy is evaluated at runtime to quantify the policy's reliability and identify unseen scenarios. In addition, a complementary principle-based policy is developed using the intelligent driver model (IDM) and the model for minimizing overall braking induced by lane changes (MOBIL). It will take over the DDPG policy when encountering unseen scenarios to guarantee a lower-bound performance of the decision-making system. Finally, the proposed method is implemented on an embedded system, i.e., NVIDIA Jetson AGX Xavier, and out-of-training distribution challenging cases are considered in the experiment, i.e., observation with sensor noise, traffic density increasing significantly, objects falling from the front vehicle, and road construction causing temporal changes in road structure. Results indicate that the proposed framework outperforms state-of-the-art benchmarks. Additionally, the code is provided https://github.com/Kayne0401/Robust-Decision-Making-Framework.

High-Level Decision Making for Automated Highway Driving via Behavior Cloning

Implicit predictive behavior cloning for autonomous driving decision-making in urban traffic

Driving Behavior Modeling and Characteristic Learning for Human-like Decision-Making in Highway

Automated vehicle's behavior decision making using deep reinforcement learning and high-fidelity simulation environment

Learning a Decision Module by Imitating Driver's Control Behaviors

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Decision-Making for Autonomous Vehicles with Interaction-Aware Behavioral Prediction and Social-Attention Neural Network

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

A Game-Theoretical Approach to Driving Decision Making in Highway Scenarios.

Driver Behavioral Cloning for Route Following in Autonomous Vehicles Using Task Knowledge Distillation

A Behavior Decision Method Based on Reinforcement Learning for Autonomous Driving

Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving

Human-like Decision Making for Autonomous Lane Changing Using Deep Learning

Data Augmented Deep Behavioral Cloning for Urban Traffic Control Operations Under a Parallel Learning Framework

Autonomous Highway Driving using Deep Reinforcement Learning

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Brain-Inspired Modelling and Decision-making for Human-Like Autonomous Driving in Mixed Traffic Environment

Decision Making for Autonomous Driving in Interactive Merge Scenarios via Learning-based Prediction

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

Towards Robust Decision-Making for Autonomous Driving on Highway

Deep Reinforcement Learning Based High-level Driving Behavior Decision-making Model in Heterogeneous Traffic