Deep Reinforcement Learning for Autonomous Driving: A Survey

B Ravi Kiran,Ibrahim Sobh,Victor Talpaert,Patrick Mannion,Ahmad A. Al Sallab,Senthil Yogamani,Patrick Pérez

DOI: https://doi.org/10.48550/arXiv.2002.00444

2021-01-24

Abstract:With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. This review summarises deep reinforcement learning (DRL) algorithms and provides a taxonomy of automated driving tasks where (D)RL methods have been employed, while addressing key computational challenges in real world deployment of autonomous driving agents. It also delineates adjacent domains such as behavior cloning, imitation learning, inverse reinforcement learning that are related but are not classical RL algorithms. The role of simulators in training agents, methods to validate, test and robustify existing solutions in RL are discussed.

Machine Learning,Artificial Intelligence,Robotics

What problem does this paper attempt to address?

The paper attempts to address the problem of how to utilize Deep Reinforcement Learning (DRL) to achieve autonomous driving in the field of self-driving cars. Specifically, the paper focuses on the following aspects:

1. **Review of DRL Algorithms**: The paper provides a detailed summary of DRL algorithms and offers a classification of tasks in autonomous driving, including driving policy, predictive perception, path and motion planning, and low-level controller design.

2. **Addressing Computational Challenges in Real-World Deployment**: The paper discusses the key computational challenges and risks faced when deploying DRL algorithms in the real world, such as sample complexity, validation, safe exploration, credit assignment, the simulator-reality gap, and learning of function approximators.

3. **Discussion of Related Fields**: The paper also explores other fields related to DRL, such as behavior cloning, imitation learning, and inverse reinforcement learning. Although these methods are not classical RL algorithms, they have important applications in autonomous driving.

4. **Role of Simulators**: The paper discusses the role of simulators in training agents, validation, testing, and enhancing existing solutions.

5. **Future Research Directions**: The paper points out the open issues and future research directions of current DRL in the field of autonomous driving, particularly the practical challenges in implementation and deployment.

Overall, the paper aims to provide a comprehensive review of DRL for researchers and engineers in the field of autonomous driving, helping them to better understand and apply DRL technology.