Abstract:Reinforcement learning (RL) is a promising way to achieve human-like autonomous driving (HAD) in complex and dynamic traffic, but faces challenges such as low sample efficiency, partial observability, and sim2real transfer. In light of this, a comprehensive solution for RL-driven HAD is established. First, an efficient training scheme called Deep Recurrent Q-learning from demonstration algorithm (DRQfD) is proposed for lane-changing decision-making to address the low sample efficiency in RL and the poor generalization capability in Imitation Learning (IL). The inherent LSTM structure potentially learns to predict future states of surrounding vehicles, helping to address the partially observable problem in autonomous driving (AD). Second, to reduce the sim2real gap, a twin high-fidelity simulator is built based on ROS-Gazebo for simulating LiDAR sensing, model training, and evaluations. Domain randomization is used to improve the robustness and generalization ability, making it easier for the model to be transferred to real-world scenarios. In addition, for the multi-objective optimization and imbalanced data issues in this scenario, a hierarchical decision-making framework is proposed to decompose the complex decision-making problem into several subtasks, making the driving policies easier to converge. To avoid the excessive dependence of the decision-making module on the output of perception module in modular systems, we train each modularized skill in an end-to-end manner. Moreover, we compare our method with a vanilla RL method to show improvement in learning efficiency. Comparisons between RL-based model and IL baseline in terms of safety, travel efficiency, and human-likeness are also given. To further validate the generalization ability of our model, we test the model on real traffic dataset. Finally, we implement the RL model on physical cars to demonstrate the performance of sim2real transfer.

A Fuzzy-Inference-based Reinforcement Learning Method of Overtaking Decision Making for Automated Vehicles

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

A Deep Reinforcement Learning Based Approach for Autonomous Overtaking

Predictive Freeway Overtaking Strategy for Automated Vehicles Us-ing Deep Reinforcement Learning

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

A Comparative Analysis of Deep Reinforcement Learning-enabled Freeway Decision-making for Automated Vehicles

Intelligent Vehicle Decision-Making and Trajectory Planning Method Based on Deep Reinforcement Learning in the Frenet Space

Graph Convolution Reinforcement Learning for Decision-Making in Highway Overtaking Scenario

A Behavior Decision Method Based on Reinforcement Learning for Autonomous Driving

Automated vehicle's behavior decision making using deep reinforcement learning and high-fidelity simulation environment

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

From Naturalistic Traffic Data to Learning-Based Driving Policy: A Sim-to-Real Study

Towards Robust Decision-Making for Autonomous Highway Driving Based on Safe Reinforcement Learning

Integrated Decision and Control: Towards Interpretable and Computationally Efficient Driving Intelligence

Overcoming driving challenges in complex urban traffic: A multi-objective eco-driving strategy via safety model based reinforcement learning

Human-Like Decision Making for Autonomous Vehicles at the Intersection Using Inverse Reinforcement Learning

Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach

Uncertainty-Aware Decision-Making for Autonomous Driving at Uncontrolled Intersections

Road Traffic Law Adaptive Decision-making for Self-Driving Vehicles

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments