Abstract:Autonomous vehicles have received considerable attention, yet high-speed path following control remains a critical and challenging issue. At high speeds, achieving perfect control based on an accurate dynamic model of autonomous vehicles is difficult due to the nonlinear model parameters that change at the driving limit. Moreover, the strong coupling relationship between longitudinal control and lateral control also affects control performance. To address these challenges, a reinforcement learning-based control approach (RL-controller) is developed in this paper and applied to the high-speed path following task. The proposed RL-controller overcomes the challenges of explicit modeling and tight coupling control. Firstly, to obtain efficient learning features, our RL-controller is developed using a deep soft actor-critic method that incorporates multi-layer dense connection networks with skip connections and feature reuse. Secondly, an estimation method of the lane curvature is developed, which is chosen as prior knowledge to augment the input state of reinforcement learning. We model the lane using a transformer-based network structure that utilizes a third-order polynomial and train the model on our self-collected dataset. Thirdly, intuitive reward functions are built from the cross-track error, the angle error and the sideslip angle. At last, we verify our proposed RL-controller utilizing an open autonomous driving simulator. Compared with imitation learning and model-based optimal control methods, our RL-controller outperforms them in terms of the driving speed and compound error.

High-speed System and Robust Control in Highway

THMR-V: an Effective and Robust High-Speed System in Structured Road

Research and Implementation of Networked Cloud-Controlled Autonomous Driving System

Motorway Traffic Surveillance and Control

A hierarchical hybrid system of integrated longitudinal and lateral control for intelligent vehicles

An Intelligent Monitoring System of Vehicles on Highway Traffic

System Design and Virtual Implementation of the High Speed Special Track Vehicle

Urban Expressway Traffic Flow Modeling And Control Using Artifical Neural Networks

A Hierarchical Control System for Autonomous Driving towards Urban Challenges

System and Experiments of Model-Driven Motion Planning and Control for Autonomous Vehicles

Safe and Ecological Speed Control for Heavy-Duty Vehicles on Long–Steep Downhill and Sharp-Curved Roads

Control System for the Mountainous Orchard Electric-Drive Monorail Transporter

Hierarchical Speed Planner for Automated Vehicles: A Framework for Lagrangian Variable Speed Limit in Mixed Autonomy Traffic

End-to-end deep learning-based autonomous driving control for high-speed environment

Autonomous Highway Car Following System Based on Fuzzy Control

Interaction-aware Traffic Prediction and Scenario-based Model Predictive Control for Autonomous Vehicles on Highways

Autonomous High-speed Overtaking of Intelligent Chassis Using Fast Iterative Model Predictive Control

Design and implementation of driving control system for autonomous vehicle

Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles

Intelligent Vehicle Detection and Tracking for Highway Driving