Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

A Gain-Scheduled Robust Controller for Autonomous Vehicles Path Tracking Based on LPV System with MPC and H ∞ .

Learning-Based Hierarchical Model Predictive Control for Drift Vehicles

A Novel Robust H∞ Control Approach Based on Vehicle Lateral Dynamics for Practical Path Tracking Applications

Model-Predictive-Control-Based Path Tracking Controller of Autonomous Vehicle Considering Parametric Uncertainties and Velocity-Varying

Path Tracking and Direct Yaw Moment Coordinated Control Based on Robust MPC With the Finite Time Horizon for Autonomous Independent-Drive Vehicles

Robust trajectory tracking control for autonomous vehicle subject to velocity-varying and uncertain lateral disturbance

Gain-Scheduled ${lpv/h_{\infty }}$ Strategy for Steering and Braking Coordination of Intelligent Commercial Vehicle Lateral Automation

Robust path following control of 4WID autonomous vehicle with driving condition adaptive mechanism

Path tracking control strategy for off-road 4WS4WD vehicle based on robust model predictive control

Preview-Based Path-tracking Stability Control with Vehicle Dynamic Uncertainty via Robust Weighted LPV/H∞ Technique

Robust LMI-Based H-Infinite Controller Integrating AFS and DYC of Autonomous Vehicles with Parametric Uncertainties

Gain-Scheduled Steering and Braking Coordinated Control in Path Tracking of Intelligent Heavy Vehicles

Gain-scheduling LPV synthesis H∞ robust lateral motion control for path following of autonomous vehicle via coordination of steering and braking

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

An improved gain-scheduling robust MPC for path following of autonomous independent-drive electric vehicles with time-varying and uncertainties

A novel path tracking system for autonomous vehicle based on model predictive control

Self-Scheduling Robust Preview Controllers for Path Tracking and Autonomous Vehicles

A Robust Combinatorial Path Tracking Controller of Automated Vehicle Considering Parametric Uncertainties and Perturbation Caused by Curvature.

Intelligent Vehicle Path Tracking Control Based on Improved MPC and Hybrid PID

Coupled Lateral and Longitudinal Control for Trajectory Tracking, Lateral Stability, and Rollover Prevention of High-Speed Automated Vehicles Using Minimum-Time Model Predictive Control

Adaptive robust control for reliable trajectory tracking of autonomous vehicle in uncertain driving environment