Abstract:Due to the complexity of the driving environment and the dynamics of the behavior of traffic participants, self-driving in dense traffic flow is very challenging. Traditional methods usually rely on predefined rules, which are difficult to adapt to various driving scenarios. Deep reinforcement learning (DRL) shows advantages over rule-based methods in complex self-driving environments, demonstrating the great potential of intelligent decision-making. However, one of the problems of DRL is the inefficiency of exploration; typically, it requires a lot of trial and error to learn the optimal policy, which leads to its slow learning rate and makes it difficult for the agent to learn well-performing decision-making policies in self-driving scenarios. Inspired by the outstanding performance of supervised learning in classification tasks, we propose a self-driving intelligent control method that combines human driving experience and adaptive sampling supervised actor-critic algorithm. Unlike traditional DRL, we modified the learning process of the policy network by combining supervised learning and DRL and adding human driving experience to the learning samples to better guide the self-driving vehicle to learn the optimal policy through human driving experience and real-time human guidance. In addition, in order to make the agent learn more efficiently, we introduced real-time human guidance in its learning process, and an adaptive balanced sampling method was designed for improving the sampling performance. We also designed the reward function in detail for different evaluation indexes such as traffic efficiency, which further guides the agent to learn the self-driving intelligent control policy in a better way. The experimental results show that the method is able to control vehicles in complex traffic environments for self-driving tasks and exhibits better performance than other DRL methods.

A Survey about the Decision-making of Self-driving Based on Deep Reinforcement Learning

Towards Autonomous Driving Decision by Combining Self-attention and Deep Reinforcement Learning.

A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learning

Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning

Review of Autonomous Driving Decision-Making Research Based on Reinforcement Learning

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

A Review on Deep Reinforcement Learning for Autonomous Driving

Decision-making in Autonomous Driving by Reinforcement Learning Combined with Planning & Control

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Decision Making for Autonomous Driving Via Multimodal Transformer and Deep Reinforcement Learning * .

Intelligent control of self-driving vehicles based on adaptive sampling supervised actor-critic and human driving experience

A Behavior Decision Method Based on Reinforcement Learning for Autonomous Driving

A Comprehensive Driving Decision-Making Methodology Based on Deep Reinforcement Learning for Automated Commercial Vehicles

Decision-making for Autonomous Vehicles on Highway: Deep Reinforcement Learning with Continuous Action Horizon

Deep Reinforcement Learning for Autonomous Driving Systems

Autonomous Driving in the Uncertain Traffic——a Deep Reinforcement Learning Approach

Hierarchical Reinforcement Learning for Self-Driving Decision-Making without Reliance on Labeled Driving Data

A Survey of Deep RL and IL for Autonomous Driving Policy Learning

A Decision-Making Strategy for Vehicle Autonomous Braking in Emergency via Deep Reinforcement Learning