Abstract:Autonomous driving in urban areas is challenging because it requires understanding vehicle movements, traffic rules, map topologies and unknown environments in the highly complex driving environment, and thus typical urban traffic scenarios include various potentially hazardous situations. Therefore, training self-driving cars by using traditional deep learning models not only requires the labelling of numerous datasets but also takes a large amount of time. Because of this, it is important to find better alternatives for effectively training self-driving cars to handle vehicle behavior and complex road shapes in dynamic environments and to follow line guidance information. In this paper, we propose a method for training a self-driving car in simulated urban traffic scenarios to be able to judge the road conditions on its own for crossing an unsignalized intersection. In order to identify the behavior of traffic flow at the intersection, we use the CARLA (CAR Learning to Act) self-driving car simulator to build the intersection environment and simulate the process of traffic operation. Moreover, we attempt to use the DDPG (Deep Deterministic Policy Gradient) and RDPG (Recurrent Deterministic Policy Gradient) learning algorithms of the DRL (Deep Reinforcement Learning) technology to train models based on the CNN (Convolutional Neural Network) architecture. Specifically, the observation image of the semantic segmentation camera installed on the self-driving car and the vehicle speed are used as the model input. Moreover, we design an appropriate reward mechanism for performing training according to the current situation of the self-driving car judged from sensing data of the obstacle sensor, collision sensor and lane invasion detector. Doing so can improve the convergence speed of the model to achieve the purpose of the self-driving car autonomously judging the driving paths so as to accomplish accurate and stable autonomous driving control.

A Vision-Based Method for Improving the Safety of Self-Driving

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

Machine vision-based autonomous road hazard avoidance system for self-driving vehicles

Driving Assistance System Based on Deep Learning and Traditional Vision

Deep learning and control algorithms of direct perception for autonomous driving

Autonomous Driving Control for Passing Unsignalized Intersections Using the Semantic Segmentation Technique

Vision-Based Environmental Perception for Autonomous Driving

Attention-Based Deep Driving Model for Autonomous Vehicles with Surround-View Cameras

Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network

Perception, Planning and Control for Self-Driving System Based on On-board Sensors

Vision-based Navigation of Autonomous Vehicle in Roadway Environments with Unexpected Hazards

Adaptive Visual Interaction Based Multi-Target Future State Prediction For Autonomous Driving Vehicles

Involvement of Deep Learning for Vision Sensor-Based Autonomous Driving Control: A Review

Multitarget Vehicle Tracking and Motion State Estimation Using a Novel Driving Environment Perception System of Intelligent Vehicles

An End-to-end Auto-driving Method Based on 3D Lidar

Research on Road Environmental Sense Method of Intelligent Vehicle Based on Tracking Check

Enhancing scene understanding based on deep learning for end-to-end autonomous driving

Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Driving