Abstract:Developing and testing automated driving models in the real world might be challenging and even dangerous, while simulation can help with this, especially for challenging maneuvers. Deep reinforcement learning (DRL) has the potential to tackle complex decision-making and controlling tasks through learning and interacting with the environment, thus it is suitable for developing automated driving while not being explored in detail yet. This study carried out a comprehensive study by implementing, evaluating, and comparing the two DRL algorithms, Deep Q-networks (DQN) and Trust Region Policy Optimization (TRPO), for training automated driving on the highway-env simulation platform. Effective and customized reward functions were developed and the implemented algorithms were evaluated in terms of onlane accuracy (how well the car drives on the road within the lane), efficiency (how fast the car drives), safety (how likely the car is to crash into obstacles), and comfort (how much the car makes jerks, e.g., suddenly accelerates or brakes). Results show that the TRPO-based models with modified reward functions delivered the best performance in most cases. Furthermore, to train a uniform driving model that can tackle various driving maneuvers besides the specific ones, this study expanded the highway-env and developed an extra customized training environment, namely, ComplexRoads, integrating various driving maneuvers and multiple road scenarios together. Models trained on the designed ComplexRoads environment can adapt well to other driving maneuvers with promising overall performance. Lastly, several functionalities were added to the highway-env to implement this work. The codes are open on GitHub at <a class="link-external link-https" href="https://github.com/alaineman/drlcarsim-paper" rel="external noopener nofollow">this https URL</a>.

Exploring DQN-Based Reinforcement Learning in Autonomous Highway Navigation Performance Under High-Traffic Conditions

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Autonomous Highway Driving using Deep Reinforcement Learning

Dueling Deep Q Network for Highway Decision Making in Autonomous Vehicles: A Case Study

A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Explaining a Deep Reinforcement Learning (DRL)-Based Automated Driving Agent in Highway Simulations

Implicit Sensing in Traffic Optimization: Advanced Deep Reinforcement Learning Techniques

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

Graph Convolution Reinforcement Learning for Decision-Making in Highway Overtaking Scenario

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Real-time deep reinforcement learning based vehicle navigation

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

Improving the Performance of Autonomous Driving through Deep Reinforcement Learning

A Hybrid Deep Reinforcement Learning and Optimal Control Architecture for Autonomous Highway Driving

Decision-making for Autonomous Vehicles on Highway: Deep Reinforcement Learning with Continuous Action Horizon

Urban Driving with Multi-Objective Deep Reinforcement Learning

DQN Algorithm for network resource management in vehicular communication network

Towards Robust Decision-Making for Autonomous Driving on Highway