Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA

Ghadi Nehme,Tejas Y. Deo

2023-10-23

Abstract:Autonomous vehicles have the potential to revolutionize transportation, but they must be able to navigate safely in traffic before they can be deployed on public roads. The goal of this project is to train autonomous vehicles to make decisions to navigate in uncertain environments using deep reinforcement learning techniques using the CARLA simulator. The simulator provides a realistic and urban environment for training and testing self-driving models. Deep Q-Networks (DQN) are used to predict driving actions. The study involves the integration of collision sensors, segmentation, and depth camera for better object detection and distance estimation. The model is tested on 4 different trajectories in presence of different types of 4-wheeled vehicles and pedestrians. The segmentation and depth cameras were utilized to ensure accurate localization of objects and distance measurement. Our proposed method successfully navigated the self-driving vehicle to its final destination with a high success rate without colliding with other vehicles, pedestrians, or going on the sidewalk. To ensure the optimal performance of our reinforcement learning (RL) models in navigating complex traffic scenarios, we implemented a pre-processing step to reduce the state space. This involved processing the images and sensor output before feeding them into the model. Despite significantly decreasing the state space, our approach yielded robust models that successfully navigated through traffic with high levels of safety and accuracy.

Artificial Intelligence,Robotics

What problem does this paper attempt to address?

This paper aims to address the issue of safe navigation for autonomous vehicles in uncertain environments. Specifically, the research goal is to train autonomous vehicles using deep reinforcement learning techniques so that they can make decisions in complex traffic scenarios and safely reach their destinations. The paper achieves this goal through the following points:

1. **Deep Reinforcement Learning (Deep RL)**: Utilizing deep reinforcement learning methods, particularly Deep Q-Network (DQN), to predict driving actions, enabling the vehicle to learn how to make optimal decisions in complex traffic environments.

2. **Sensor Data Preprocessing**: Combining collision sensors, segmented images, and depth cameras to preprocess sensor data, improving the accuracy of object detection and distance estimation. This step reduces the size of the state space and enhances the efficiency of model training.

3. **Application of CARLA Simulator**: Using the CARLA simulator to provide realistic urban environments for training and testing. The simulator not only offers a safe and controllable testing environment but also generates a large amount of data for training.

4. **Multi-Model Integration**: Proposing a hierarchical architecture that combines braking models and driving models to ensure that the vehicle can follow the planned path in different traffic conditions while also responding promptly to emergencies to avoid collisions.

Through the above methods, the paper demonstrates that the proposed model can successfully navigate to the destination in various traffic scenarios with a high success rate and safety.