Abstract:Due to the complexity of the driving environment and the dynamics of the behavior of traffic participants, self-driving in dense traffic flow is very challenging. Traditional methods usually rely on predefined rules, which are difficult to adapt to various driving scenarios. Deep reinforcement learning (DRL) shows advantages over rule-based methods in complex self-driving environments, demonstrating the great potential of intelligent decision-making. However, one of the problems of DRL is the inefficiency of exploration; typically, it requires a lot of trial and error to learn the optimal policy, which leads to its slow learning rate and makes it difficult for the agent to learn well-performing decision-making policies in self-driving scenarios. Inspired by the outstanding performance of supervised learning in classification tasks, we propose a self-driving intelligent control method that combines human driving experience and adaptive sampling supervised actor-critic algorithm. Unlike traditional DRL, we modified the learning process of the policy network by combining supervised learning and DRL and adding human driving experience to the learning samples to better guide the self-driving vehicle to learn the optimal policy through human driving experience and real-time human guidance. In addition, in order to make the agent learn more efficiently, we introduced real-time human guidance in its learning process, and an adaptive balanced sampling method was designed for improving the sampling performance. We also designed the reward function in detail for different evaluation indexes such as traffic efficiency, which further guides the agent to learn the self-driving intelligent control policy in a better way. The experimental results show that the method is able to control vehicles in complex traffic environments for self-driving tasks and exhibits better performance than other DRL methods.

Road Tracking Using Deep Reinforcement Learning for Self-driving Car Applications

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

ReinforcementDriving: Exploring Trajectories and Navigation for Autonomous Vehicles

Autonomous Highway Driving using Deep Reinforcement Learning

Reinforcement-Tracking: An Effective Trajectory Tracking and Navigation Method for Autonomous Urban Driving

Deep Reinforcement Learning framework for Autonomous Driving

End-to-End Deep Reinforcement Learning for Lane Keeping Assist

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving

An End-to-end Deep Reinforcement Learning Approach for the Long-term Short-term Planning on the Frenet Space

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Advancing Autonomous Navigation: Deep Learning Techniques for Self-Driving Cars

Deep Learning Applications for Autonomous Driving

Advancements in Deep Learning for Autonomous Driving in Indian Road Conditions

Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues

Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

Towards Brain-inspired System: Deep Recurrent Reinforcement Learning for Simulated Self-driving Agent

Autonomous driving in traffic with end-to-end vision-based deep learning

Intelligent control of self-driving vehicles based on adaptive sampling supervised actor-critic and human driving experience