Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

A Learning-Based Controller for Trajectory Tracking of Autonomous Vehicles in Complex and Uncertain Scenarios

Learning-Based MPC Controller for Drift Control of Autonomous Vehicles

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

A Learning-Based Model Predictive Trajectory Planning Controller for Automated Driving in Unstructured Dynamic Environments

Learning-Based Neural Dynamic Surface Predictive Control for MMC

A Traffic Adapative Physics-informed Learning Control for Energy Savings of Connected and Automated Vehicles

Neuro-adaptive Trajectory Tracking Control of Underactuated Autonomous Surface Vehicles with High-Gain Observer

Cost-Guaranteed Trajectory Tracking Control for Automated Driving System

A Spatial Learning-Based Fault Tolerant Lateral Tracking Control for Autonomous Driving

Design of Path Tracking Controller for Autonomous Vehicles Through Bias Learning of Vehicle Dynamic Models Under Environmental Uncertainty

Improvement of a Learning-Based Tuning Approach for Trajectory Tracking Controller

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Adaptive Asymmetric Time-Varying Integral Barrier Lyapunov Control-Based Trajectory Tracking of Autonomous Vehicles

Model predictive trajectory optimization and tracking for on-road autonomous vehicles

An Adaptive Hierarchical Trajectory Following Control Approach of Autonomous Four-Wheel Independent Drive Electric Vehicles.

Adaptive Dynamic Surface Longitudinal Tracking Control of Autonomous Vehicles

Learning to Control of an Under-actuated Autonomous Surface Vehicle Based on Model-based Deep Reinforcement Learning

A Finite-Time Safety Filter for Learning-Based Autonomous Driving

Adaptive robust control for reliable trajectory tracking of autonomous vehicle in uncertain driving environment

A Parameter Adaptive Trajectory Tracking and Motion Control Framework for Autonomous Vehicle