Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

Human-Tailored Data-Driven Control System of Autonomous Vehicles

Learning-Based Hierarchical Model Predictive Control for Drift Vehicles

Predictive Control Method of Autonomous Vehicle Based on Tracking-error Model

Learning-Based MPC Controller for Drift Control of Autonomous Vehicles

Data-Driven Enhancements for MPC-Based Path Tracking Controller in Autonomous Vehicles

A Data-Based Approach to Path Following Controller Design for Autonomous Vehicles

Effective adoption of vehicle models for autonomous vehicle path tracking: a switched MPC approach

Mpc-Based Path Tracking Controller Design For Autonomous Ground Vehicles

MPC-based Path Tracking with PID Speed Control for High-Speed Autonomous Vehicles Considering Time-Optimal Travel

Optimal Design of MPC Autonomous Vehicle Trajectory Tracking Controller Considering Variable Time Domain

Adaptive MPC path-tracking controller based on reinforcement learning and preview-based PID controller

Personalized driving behavior oriented autonomous vehicle control for typical traffic situations

Mixed Local Motion Planning and Tracking Control Framework for Autonomous Vehicles Based on Model Predictive Control

How Imitation Learning and Human Factors Can Be Combined in a Model Predictive Control Algorithm for Adaptive Motion Planning and Control

Design And Evaluation Of Path Following Controller Based On Mpc For Autonomous Vehicle

MPC-Based Path Tracking Controller Design for Intelligent Driving Vehicle

Research on Trajectory Tracking Control of Intelligent Vehicles Based on Model Predictive Control

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Lane Detection and Trajectory Tracking Control of Autonomous Vehicle Based on Model Predictive Control

A Model Predictive Control with Preview-Follower Theory Algorithm for Trajectory Tracking Control in Autonomous Vehicles

Coupled Lateral and Longitudinal Control for Trajectory Tracking, Lateral Stability, and Rollover Prevention of High-Speed Automated Vehicles Using Minimum-Time Model Predictive Control