Abstract:Due to the complexity of the driving environment and the dynamics of the behavior of traffic participants, self-driving in dense traffic flow is very challenging. Traditional methods usually rely on predefined rules, which are difficult to adapt to various driving scenarios. Deep reinforcement learning (DRL) shows advantages over rule-based methods in complex self-driving environments, demonstrating the great potential of intelligent decision-making. However, one of the problems of DRL is the inefficiency of exploration; typically, it requires a lot of trial and error to learn the optimal policy, which leads to its slow learning rate and makes it difficult for the agent to learn well-performing decision-making policies in self-driving scenarios. Inspired by the outstanding performance of supervised learning in classification tasks, we propose a self-driving intelligent control method that combines human driving experience and adaptive sampling supervised actor-critic algorithm. Unlike traditional DRL, we modified the learning process of the policy network by combining supervised learning and DRL and adding human driving experience to the learning samples to better guide the self-driving vehicle to learn the optimal policy through human driving experience and real-time human guidance. In addition, in order to make the agent learn more efficiently, we introduced real-time human guidance in its learning process, and an adaptive balanced sampling method was designed for improving the sampling performance. We also designed the reward function in detail for different evaluation indexes such as traffic efficiency, which further guides the agent to learn the self-driving intelligent control policy in a better way. The experimental results show that the method is able to control vehicles in complex traffic environments for self-driving tasks and exhibits better performance than other DRL methods.

Continuous Improvement of Self-Driving Cars Using Dynamic Confidence-Aware Reinforcement Learning

Confidence-Aware Reinforcement Learning for Self-Driving Cars

Trustworthy safety improvement for autonomous driving using reinforcement learning

Cautious Adaptation For Reinforcement Learning in Safety-Critical Settings

A Safe and Efficient Self-evolving Algorithm for Decision-making and Control of Autonomous Driving Systems

Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Driving

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Safe Autonomous Driving with Latent Dynamics and State-Wise Constraints

Dense reinforcement learning for safety validation of autonomous vehicles

Improved Deep Reinforcement Learning for Car-Following Decision-Making

Intelligent control of self-driving vehicles based on adaptive sampling supervised actor-critic and human driving experience

Human-Like Autonomous Car-Following Model with Deep Reinforcement Learning

A deep reinforcement learning-based active suspension control algorithm considering deterministic experience tracing for autonomous vehicle

Deep Reinforcement Learning for Advanced Longitudinal Control and Collision Avoidance in High-Risk Driving Scenarios

Safe Driving Of Autonomous Vehicles Through Improved Deep Reinforcement Learning

Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving

Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarios

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

Dynamically Conservative Self-Driving Planner for Long-Tail Cases

Improving the Performance of Autonomous Driving through Deep Reinforcement Learning