Abstract:Developing and testing automated driving models in the real world might be challenging and even dangerous, while simulation can help with this, especially for challenging maneuvers. Deep reinforcement learning (DRL) has the potential to tackle complex decision-making and controlling tasks through learning and interacting with the environment, thus it is suitable for developing automated driving while not being explored in detail yet. This study carried out a comprehensive study by implementing, evaluating, and comparing the two DRL algorithms, Deep Q-networks (DQN) and Trust Region Policy Optimization (TRPO), for training automated driving on the highway-env simulation platform. Effective and customized reward functions were developed and the implemented algorithms were evaluated in terms of onlane accuracy (how well the car drives on the road within the lane), efficiency (how fast the car drives), safety (how likely the car is to crash into obstacles), and comfort (how much the car makes jerks, e.g., suddenly accelerates or brakes). Results show that the TRPO-based models with modified reward functions delivered the best performance in most cases. Furthermore, to train a uniform driving model that can tackle various driving maneuvers besides the specific ones, this study expanded the highway-env and developed an extra customized training environment, namely, ComplexRoads, integrating various driving maneuvers and multiple road scenarios together. Models trained on the designed ComplexRoads environment can adapt well to other driving maneuvers with promising overall performance. Lastly, several functionalities were added to the highway-env to implement this work. The codes are open on GitHub at <a class="link-external link-https" href="https://github.com/alaineman/drlcarsim-paper" rel="external noopener nofollow">this https URL</a>.

A Deep Reinforcement Learning Algorithm with Expert Demonstrations and Supervised Loss and Its Application in Autonomous Driving

Continuous Reinforcement Learning From Human Demonstrations With Integrated Experience Replay For Autonomous Driving

Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving

Autonomous driving policy learning from demonstration using regression loss function

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

Self-Driving Via Improved DDPG Algorithm

Efficient Deep Reinforcement Learning with Imitative Expert Priors for Autonomous Driving

Autonomous Driving Control Using the DDPG and RDPG Algorithms

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

Enhancing Car-Following Performance in Traffic Oscillations Using Expert Demonstration Reinforcement Learning

A Methodology Based on Deep Reinforcement Learning to Autonomous Driving with Double Q-Learning

Multi-Input Autonomous Driving Based on Deep Reinforcement Learning with Double Bias Experience Replay

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

Decision-making in Autonomous Driving by Reinforcement Learning Combined with Planning & Control

A Deep Reinforcement Learning Algorithm Suitable for Autonomous Vehicles: Double Bootstrapped Soft-Actor-Critic-Discrete

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Deep Deterministic Policy Gradient Algorithm Based on Convolutional Block Attention for Autonomous Driving.

Deep Reinforcement Learning for Autonomous Driving Systems

Deep Reinforcement Learning for Autonomous Driving with an Auxiliary Actor Discriminator

A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles