Improving the Performance of Autonomous Driving through Deep Reinforcement Learning

Akshaj Tammewar,Nikita Chaudhari,Bunny Saini,Divya Venkatesh,Ganpathiraju Dharahas,Deepali Vora,Shruti Patil,Ketan Kotecha,Sultan Alfarhood

DOI: https://doi.org/10.3390/su151813799

IF: 3.9

2023-09-16

Sustainability

Abstract:Reinforcement learning (RL) is revolutionizing the artificial intelligence (AI) domain and significantly aiding in building autonomous systems with a higher level comprehension of the world as we observe it. Deep learning (DL) facilitates RL to scale and resolve previously intractable problems, for instance, allowing supervision principles designed for robots to be acquired directly from visual data, developing video game proficiency from pixel-level information, etc. Recent research shows that RL algorithms help represent problems dealing with high-dimensional, unprocessed data input and can have successful applications in computer vision, pattern identification, natural language analysis, and speech parsing. This research paper focuses on training a simulation model of a car to navigate autonomously on a racetrack using RL. The study explores several fundamental algorithms in Deep RL, namely Proximal Policy Optimization (PPO), Deep Q-network (DQN), and Deep Deterministic Policy Gradient (DDPG). The paper documents a comparative analysis of these three prominent algorithms—based on their speed, accuracy, and overall performance. After a thorough evaluation, the research indicates that the DQN surpassed the other existing algorithms. This study further examined the performance of the DQN with and without ε-decay and observed that the DQN with ε-decay is better suited for our objective and is significantly more stable than its non ε-decay counterpart. The findings from this research could assist in improving the performance and stability of autonomous vehicles using the DQN with ε -decay. It concludes by discussing the fine-tuning of the model for future real-world applications and the potential research areas within the field of autonomous driving.

environmental sciences,environmental studies,green & sustainable science & technology

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to improve the navigation performance of self - driving cars on the track through deep reinforcement learning (DRL). Specifically, the researchers aim to train a simulation model so that the vehicle can drive autonomously on randomly generated tracks and complete the track as quickly as possible. To achieve this goal, three main deep reinforcement learning algorithms are explored and implemented in the paper: Proximal Policy Optimization (PPO), Deep Q - Network (DQN) and Deep Deterministic Policy Gradient (DDPG). The study also pays special attention to the performance of these algorithms in a low - computing - resource environment and compares their speed, accuracy and overall performance. In addition, the study also explores the performance differences between DQN with ε - decay and DQN without ε - decay, and finds that DQN with ε - decay is more suitable for their goals and significantly superior to the version without ε - decay in terms of stability. These findings are helpful to improve the performance and stability of self - driving cars using DQN and ε - decay techniques, thus providing support for future practical applications.

Improving the Performance of Autonomous Driving through Deep Reinforcement Learning

Self-Driving Car Racing: Application of Deep Reinforcement Learning

Optimizing Autonomous Vehicle Navigation with DQN and PPO: A Reinforcement Learning Approach

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Autonomous Highway Driving using Deep Reinforcement Learning

Deep reinforcement learning for autonomous driving in uncontrolled intersections of Indian roads

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Deep Reinforcement Learning for Autonomous Driving: A Survey

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learning

Safe Driving Of Autonomous Vehicles Through Improved Deep Reinforcement Learning

End-to-End Deep Reinforcement Learning for Lane Keeping Assist

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

Robustness and Performance of Deep Reinforcement Learning.

Towards Robust Decision-Making for Autonomous Driving on Highway

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Data

Review of Deep Reinforcement Learning for Autonomous Driving

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning