Abstract:Autonomous vehicles have received considerable attention, yet high-speed path following control remains a critical and challenging issue. At high speeds, achieving perfect control based on an accurate dynamic model of autonomous vehicles is difficult due to the nonlinear model parameters that change at the driving limit. Moreover, the strong coupling relationship between longitudinal control and lateral control also affects control performance. To address these challenges, a reinforcement learning-based control approach (RL-controller) is developed in this paper and applied to the high-speed path following task. The proposed RL-controller overcomes the challenges of explicit modeling and tight coupling control. Firstly, to obtain efficient learning features, our RL-controller is developed using a deep soft actor-critic method that incorporates multi-layer dense connection networks with skip connections and feature reuse. Secondly, an estimation method of the lane curvature is developed, which is chosen as prior knowledge to augment the input state of reinforcement learning. We model the lane using a transformer-based network structure that utilizes a third-order polynomial and train the model on our self-collected dataset. Thirdly, intuitive reward functions are built from the cross-track error, the angle error and the sideslip angle. At last, we verify our proposed RL-controller utilizing an open autonomous driving simulator. Compared with imitation learning and model-based optimal control methods, our RL-controller outperforms them in terms of the driving speed and compound error.

Vision-based control in the open racing car simulator with deep and reinforcement learning

Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Driving

Towards Safety Assured End-to-End Vision-Based Control for Autonomous Racing

Racing Towards Reinforcement Learning based control of an Autonomous Formula SAE Car

DeepRacer: Educational Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning

Expert Human-Level Driving in Gran Turismo Sport Using Deep Reinforcement Learning with Image-based Representation

Vehicle Extreme Control Based on Offline Reinforcement Leaning

A Robotic Auto-Focus System based on Deep Reinforcement Learning

Deep learning and control algorithms of direct perception for autonomous driving

Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

Self-Driving Car Racing: Application of Deep Reinforcement Learning

Deep Reinforcement Learning framework for Autonomous Driving

Racing with Vision Transformer Architecture

A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismo

Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles

Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

Rapid Autonomous Car Control based on Spatial and Temporal Visual Cues

Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing

Application of Reinforcement Learning in the Autonomous Driving Platform of the DeepRacer