Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

A Model Free Controller Based on Reinforcement Learning for Active Steering System with Uncertainties

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Path Tracking Control of Autonomous Ground Vehicles Via Model Predictive Control and Deep Deterministic Policy Gradient Algorithm

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Driver-behavior-based robust steering control of unmanned driving robotic vehicle with modeling uncertainties and external disturbance

Model Predictive Control of Steering Torque in Shared Driving of Autonomous Vehicles.

MRAC Steering Controller for Unreliable Steering Systems in Lane-Change Process for Autonomous Vehicles

Model-Predictive-Control-Based Path Tracking Controller of Autonomous Vehicle Considering Parametric Uncertainties and Velocity-Varying

Adaptive robust control algorithm for enhanced path-tracking performance of automated driving in critical scenarios

Parallel Learning-Based Steering Control for Autonomous Driving.

Automatic Steering Control Strategy for Unmanned Vehicles Based on Robust Backstepping Sliding Mode Control Theory.

Adaptive Control of DC Motor Servo System with Application to Vehicle Active Steering

Model-Based Integrated Control With Vehicle States And Parameters Estimation

Coordination Control Strategy for Human-Machine Cooperative Steering of Intelligent Vehicles: A Reinforcement Learning Approach

A Novel Adaptive Steering Torque Control Approach for Human–Machine Cooperation Autonomous Vehicles

Automotive Steering System and Its Controller Design for Intelligent Vehicles

A Model-Tuned Predictive Backstepping Control Approach for Angle Following of Steer-by-Wire

Neural-Fuzzy-Based Adaptive Sliding Mode Automatic Steering Control of Vision-based Unmanned Electric Vehicles

Active steering control for autonomous vehicles based on a driver-in-the-loop platform: A case study of collision avoidance

Steering-Angle Prediction and Controller Design Based on Improved YOLOv5 for Steering-by-Wire System

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning