Abstract:Autonomous driving in urban areas is challenging because it requires understanding vehicle movements, traffic rules, map topologies and unknown environments in the highly complex driving environment, and thus typical urban traffic scenarios include various potentially hazardous situations. Therefore, training self-driving cars by using traditional deep learning models not only requires the labelling of numerous datasets but also takes a large amount of time. Because of this, it is important to find better alternatives for effectively training self-driving cars to handle vehicle behavior and complex road shapes in dynamic environments and to follow line guidance information. In this paper, we propose a method for training a self-driving car in simulated urban traffic scenarios to be able to judge the road conditions on its own for crossing an unsignalized intersection. In order to identify the behavior of traffic flow at the intersection, we use the CARLA (CAR Learning to Act) self-driving car simulator to build the intersection environment and simulate the process of traffic operation. Moreover, we attempt to use the DDPG (Deep Deterministic Policy Gradient) and RDPG (Recurrent Deterministic Policy Gradient) learning algorithms of the DRL (Deep Reinforcement Learning) technology to train models based on the CNN (Convolutional Neural Network) architecture. Specifically, the observation image of the semantic segmentation camera installed on the self-driving car and the vehicle speed are used as the model input. Moreover, we design an appropriate reward mechanism for performing training according to the current situation of the self-driving car judged from sensing data of the obstacle sensor, collision sensor and lane invasion detector. Doing so can improve the convergence speed of the model to achieve the purpose of the self-driving car autonomously judging the driving paths so as to accomplish accurate and stable autonomous driving control.

Oracle-Based Conditional Imitation Learning for Autonomous Navigation

Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersections

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

Conditional Affordance Learning for Driving in Urban Environments

Learning Autonomous Control Policy for Intersection Navigation with Pedestrian Interaction

Joint Imitation Learning of Behavior Decision and Control for Autonomous Intersection Navigation

Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic

Dynamic Conditional Imitation Learning for Autonomous Driving

Autonomous Navigation through intersections with Graph ConvolutionalNetworks and Conditional Imitation Learning for Self-driving Cars

Probabilistic End-to-End Vehicle Navigation in Complex Dynamic Environments with Multimodal Sensor Fusion

Yaw-Guided Imitation Learning for Autonomous Driving in Urban Environments

Multi-task Learning with Attention for End-to-end Autonomous Driving

Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety

Book Your Green Wave: Exploiting Navigation Information for Intelligent Traffic Signal Control

Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach

Autonomous Driving Control for Passing Unsignalized Intersections Using the Semantic Segmentation Technique

Reward-Driven Automated Curriculum Learning for Interaction-Aware Self-Driving at Unsignalized Intersections

Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Enhancing scene understanding based on deep learning for end-to-end autonomous driving

Guiding Attention in End-to-End Driving Models

Self-Learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections