Abstract:Due to the complexity of the driving environment and the dynamics of the behavior of traffic participants, self-driving in dense traffic flow is very challenging. Traditional methods usually rely on predefined rules, which are difficult to adapt to various driving scenarios. Deep reinforcement learning (DRL) shows advantages over rule-based methods in complex self-driving environments, demonstrating the great potential of intelligent decision-making. However, one of the problems of DRL is the inefficiency of exploration; typically, it requires a lot of trial and error to learn the optimal policy, which leads to its slow learning rate and makes it difficult for the agent to learn well-performing decision-making policies in self-driving scenarios. Inspired by the outstanding performance of supervised learning in classification tasks, we propose a self-driving intelligent control method that combines human driving experience and adaptive sampling supervised actor-critic algorithm. Unlike traditional DRL, we modified the learning process of the policy network by combining supervised learning and DRL and adding human driving experience to the learning samples to better guide the self-driving vehicle to learn the optimal policy through human driving experience and real-time human guidance. In addition, in order to make the agent learn more efficiently, we introduced real-time human guidance in its learning process, and an adaptive balanced sampling method was designed for improving the sampling performance. We also designed the reward function in detail for different evaluation indexes such as traffic efficiency, which further guides the agent to learn the self-driving intelligent control policy in a better way. The experimental results show that the method is able to control vehicles in complex traffic environments for self-driving tasks and exhibits better performance than other DRL methods.

A Discrete Soft Actor-Critic Decision-Making Strategy With Sample Filter for Freeway Autonomous Driving

Behavioral Decision-Making for Autonomous Driving Using Soft Actor-Critic Algorithm

Exploring Highway Overtaking and Lane Changing Based on Soft Actor Critic for Discrete Algorithm

A Distributional Soft-Actor-Critic-Discrete-Based Decision-Making Algorithm for Autonomous Driving

Highway Decision-Making and Motion Planning for Autonomous Driving via Soft Actor-Critic

AF-DQN: A Large-Scale Decision-Making Method at Unsignalized Intersections with Safe Action Filter and Efficient Exploratory Training Strategy

Decision-Making under On-Ramp merge Scenarios by Distributional Soft Actor-Critic Algorithm

Distributional Soft Actor-Critic for Decision-Making in On-Ramp Merge Scenarios

Decision-Making for Autonomous Vehicles in Random Task Scenarios at Unsignalized Intersection Using Deep Reinforcement Learning

Deep Reinforcement Learning for Autonomous Driving with an Auxiliary Actor Discriminator

Discretionary Lane-Change Decision and Control via Parameterized Soft Actor-Critic for Hybrid Action Space

Discretionary Lane-Change Decision and Control via Parameterized Soft Actor–Critic for Hybrid Action Space

A Distributed Driving Decision Scheme Based on Reinforcement Learning for Autonomous Driving Vehicles.

SMART: A Decision-Making Framework with Multi-modality Fusion for Autonomous Driving Based on Reinforcement Learning.

A Deep Reinforcement Learning Algorithm Suitable for Autonomous Vehicles: Double Bootstrapped Soft-Actor-Critic-Discrete

Research on robust decision making for intelligent connected vehicle at highway on-ramp

Intelligent control of self-driving vehicles based on adaptive sampling supervised actor-critic and human driving experience

A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Towards Robust Decision-Making for Autonomous Highway Driving Based on Safe Reinforcement Learning

Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change