Abstract:Reinforcement learning (RL) is a promising way to achieve human-like autonomous driving (HAD) in complex and dynamic traffic, but faces challenges such as low sample efficiency, partial observability, and sim2real transfer. In light of this, a comprehensive solution for RL-driven HAD is established. First, an efficient training scheme called Deep Recurrent Q-learning from demonstration algorithm (DRQfD) is proposed for lane-changing decision-making to address the low sample efficiency in RL and the poor generalization capability in Imitation Learning (IL). The inherent LSTM structure potentially learns to predict future states of surrounding vehicles, helping to address the partially observable problem in autonomous driving (AD). Second, to reduce the sim2real gap, a twin high-fidelity simulator is built based on ROS-Gazebo for simulating LiDAR sensing, model training, and evaluations. Domain randomization is used to improve the robustness and generalization ability, making it easier for the model to be transferred to real-world scenarios. In addition, for the multi-objective optimization and imbalanced data issues in this scenario, a hierarchical decision-making framework is proposed to decompose the complex decision-making problem into several subtasks, making the driving policies easier to converge. To avoid the excessive dependence of the decision-making module on the output of perception module in modular systems, we train each modularized skill in an end-to-end manner. Moreover, we compare our method with a vanilla RL method to show improvement in learning efficiency. Comparisons between RL-based model and IL baseline in terms of safety, travel efficiency, and human-likeness are also given. To further validate the generalization ability of our model, we test the model on real traffic dataset. Finally, we implement the RL model on physical cars to demonstrate the performance of sim2real transfer.

Learning autonomous race driving with action mapping reinforcement learning

Learning Autonomous Race Driving with Action Mapping Reinforcement Learning

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Vehicle Extreme Control Based on Offline Reinforcement Leaning

Constrained Residual Race: an Efficient Hybrid Controller for Autonomous Racing

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Adaptive Planning and Control with Time-Varying Tire Models for Autonomous Racing Using Extreme Learning Machine

Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Data

Autonomous Driving at the Handling Limit Using Residual Reinforcement Learning

Residual Policy Learning Facilitates Efficient Model-Free Autonomous Racing

Racing Towards Reinforcement Learning based control of an Autonomous Formula SAE Car

Learning to drive via Apprenticeship Learning and Deep Reinforcement Learning

Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles

Learning from Simulation, Racing in Reality

Safe Autonomous Driving with Latent Dynamics and State-Wise Constraints

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

From Naturalistic Traffic Data to Learning-Based Driving Policy: A Sim-to-Real Study

Reinforcement Learning from Human Feedback for Lane Changing of Autonomous Vehicles in Mixed Traffic

Self-Driving Car Racing: Application of Deep Reinforcement Learning

Application of Reinforcement Learning in the Autonomous Driving Platform of the DeepRacer