Abstract:Rule-based autonomous driving systems may suffer from increased complexity with large-scale intercoupled rules, so many researchers are exploring learning-based approaches. Reinforcement learning (RL) has been applied in designing autonomous driving systems because of its outstanding performance on a wide variety of sequential control problems. However, poor initial performance is a major challenge to the practical implementation of an RL-based autonomous driving system. RL training requires extensive training data before the model achieves reasonable performance, making an RL-based model inapplicable in a real-world setting, particularly when data are expensive. We propose an asynchronous supervised learning (ASL) method for the RL-based end-to-end autonomous driving model to address the problem of poor initial performance before training this RL-based model in real-world settings. Specifically, prior knowledge is introduced in the ASL pre-training stage by asynchronously executing multiple supervised learning processes in parallel, on multiple driving demonstration data sets. After pre-training, the model is deployed on a real vehicle to be further trained by RL to adapt to the real environment and continuously break the performance limit. The presented pre-training method is evaluated on the race car simulator, TORCS (The Open Racing Car Simulator), to verify that it can be sufficiently reliable in improving the initial performance and convergence speed of an end-to-end autonomous driving model in the RL training stage. In addition, a real-vehicle verification system is built to verify the feasibility of the proposed pre-training method in a real-vehicle deployment. Simulations results show that using some demonstrations during a supervised pre-training stage allows significant improvements in initial performance and convergence speed in the RL training stage.

Deep Reinforcement Learning Based Autonomous Racing Car Control with Priori Knowledge

Multi-policy Soft Actor-Critic Reinforcement Learning for Autonomous Racing

Deep Reinforcement Learning framework for Autonomous Driving

Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors

Efficient Deep Reinforcement Learning with Imitative Expert Priors for Autonomous Driving

End-to-end Control of Kart Agent with Deep Reinforcement Learning.

Racing Towards Reinforcement Learning based control of an Autonomous Formula SAE Car

Self-Driving Car Racing: Application of Deep Reinforcement Learning

Autonomous Driving at the Handling Limit Using Residual Reinforcement Learning

Prioritized Experience-Based Reinforcement Learning With Human Guidance for Autonomous Driving

Pre-training with Asynchronous Supervised Learning for Reinforcement Learning Based Autonomous Driving

Obstacle Avoidance for Self-Driving Vehicle with Reinforcement Learning

Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Driving

Vehicle Extreme Control Based on Offline Reinforcement Leaning

Constrained Residual Race: an Efficient Hybrid Controller for Autonomous Racing

Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving

DeepRacer: Educational Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning

Residual Policy Learning Facilitates Efficient Model-Free Autonomous Racing

Application of Reinforcement Learning in the Autonomous Driving Platform of the DeepRacer

Towards Optimal Head-to-head Autonomous Racing with Curriculum Reinforcement Learning

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning