Abstract:Due to the complexity of the driving environment and the dynamics of the behavior of traffic participants, self-driving in dense traffic flow is very challenging. Traditional methods usually rely on predefined rules, which are difficult to adapt to various driving scenarios. Deep reinforcement learning (DRL) shows advantages over rule-based methods in complex self-driving environments, demonstrating the great potential of intelligent decision-making. However, one of the problems of DRL is the inefficiency of exploration; typically, it requires a lot of trial and error to learn the optimal policy, which leads to its slow learning rate and makes it difficult for the agent to learn well-performing decision-making policies in self-driving scenarios. Inspired by the outstanding performance of supervised learning in classification tasks, we propose a self-driving intelligent control method that combines human driving experience and adaptive sampling supervised actor-critic algorithm. Unlike traditional DRL, we modified the learning process of the policy network by combining supervised learning and DRL and adding human driving experience to the learning samples to better guide the self-driving vehicle to learn the optimal policy through human driving experience and real-time human guidance. In addition, in order to make the agent learn more efficiently, we introduced real-time human guidance in its learning process, and an adaptive balanced sampling method was designed for improving the sampling performance. We also designed the reward function in detail for different evaluation indexes such as traffic efficiency, which further guides the agent to learn the self-driving intelligent control policy in a better way. The experimental results show that the method is able to control vehicles in complex traffic environments for self-driving tasks and exhibits better performance than other DRL methods.

Deep Learning Technique-Based Steering of Autonomous Car

Autonomous Driving with Human Guided Image Feature Extraction

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

Parallel Learning-Based Steering Control for Autonomous Driving.

Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues

Advancing Autonomous Navigation: Deep Learning Techniques for Self-Driving Cars

An Autonomous Driving Approach Based on Trajectory Learning Using Deep Neural Networks

An End-to-end Auto-driving Method Based on 3D Lidar

Learning End-to-End Autonomous Steering Model from Spatial and Temporal Visual Cues

End-to-End Autonomous Driving Through Dueling Double Deep Q-Network

Comparative Transfer Learning Models for End-to-End Self-Driving Car

Vehicle steering control method based on machine learning

Overview of Deep Learning Intelligent Driving Methods

Self-driving scale car trained by Deep reinforcement learning

Deep learning and control algorithms of direct perception for autonomous driving

Intelligent Road Tracking and Real-time Acceleration-deceleration for Autonomous Driving Using Modified Convolutional Neural Networks

Control method of autonomous mini-car based on deep Q-network

A Survey of Deep Learning Techniques for Autonomous Driving

A survey to applications of deep learning in autonomous driving

Improved Deep Reinforcement Learning for Car-Following Decision-Making

Intelligent control of self-driving vehicles based on adaptive sampling supervised actor-critic and human driving experience