Abstract:Due to the complexity of the driving environment and the dynamics of the behavior of traffic participants, self-driving in dense traffic flow is very challenging. Traditional methods usually rely on predefined rules, which are difficult to adapt to various driving scenarios. Deep reinforcement learning (DRL) shows advantages over rule-based methods in complex self-driving environments, demonstrating the great potential of intelligent decision-making. However, one of the problems of DRL is the inefficiency of exploration; typically, it requires a lot of trial and error to learn the optimal policy, which leads to its slow learning rate and makes it difficult for the agent to learn well-performing decision-making policies in self-driving scenarios. Inspired by the outstanding performance of supervised learning in classification tasks, we propose a self-driving intelligent control method that combines human driving experience and adaptive sampling supervised actor-critic algorithm. Unlike traditional DRL, we modified the learning process of the policy network by combining supervised learning and DRL and adding human driving experience to the learning samples to better guide the self-driving vehicle to learn the optimal policy through human driving experience and real-time human guidance. In addition, in order to make the agent learn more efficiently, we introduced real-time human guidance in its learning process, and an adaptive balanced sampling method was designed for improving the sampling performance. We also designed the reward function in detail for different evaluation indexes such as traffic efficiency, which further guides the agent to learn the self-driving intelligent control policy in a better way. The experimental results show that the method is able to control vehicles in complex traffic environments for self-driving tasks and exhibits better performance than other DRL methods.

Research on Adaptive Cruise Control Based on Soft Actor-Critic Algorithm

Behavioral Decision-Making for Autonomous Driving Using Soft Actor-Critic Algorithm

A Deep Reinforcement Learning Algorithm Suitable for Autonomous Vehicles: Double Bootstrapped Soft-Actor-Critic-Discrete

A Distributional Soft-Actor-Critic-Discrete-Based Decision-Making Algorithm for Autonomous Driving

Design and Experimental Validation of a Cooperative Adaptive Cruise Control System Based on Supervised Reinforcement Learning

Adaptive Cruise Control Based on Safe Deep Reinforcement Learning

Deep Reinforcement Learning for Autonomous Driving with an Auxiliary Actor Discriminator

Multi-policy Soft Actor-Critic Reinforcement Learning for Autonomous Racing

Action Constrained Deep Reinforcement Learning Based Safe Automatic Driving Method

Averaged Soft Actor-Critic for Deep Reinforcement Learning.

Enhancing Cooperation of Vehicle Merging Control in Heavy Traffic Using Communication-Based Soft Actor-Critic Algorithm

Soft Decomposed Policy-Critic: Bridging the Gap for Effective Continuous Control with Discrete RL

DSAC-T: Distributional Soft Actor-Critic with Three Refinements

A Comparison of Deep Reinforcement Learning Models for Isolated Traffic Signal Control

Altruistic cooperative adaptive cruise control of mixed traffic platoon based on deep reinforcement learning

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

Model Predictive Adaptive Cruise Control of Intelligent Electric Vehicles Based on Deep Reinforcement Learning Algorithm FWOR Driver Characteristics

Energy-efficient train control method based on soft actor-critic algorithm.

Path tracking control based on Deep reinforcement learning in Autonomous driving

Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-lane Scenarios

Intelligent control of self-driving vehicles based on adaptive sampling supervised actor-critic and human driving experience