Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

Longitudinal robust dynamic programming control for driving robot vehicles with performance self-learning

Learning-Based Hierarchical Model Predictive Control for Drift Vehicles

Learning-Based MPC Controller for Drift Control of Autonomous Vehicles

Lateral Robust Iterative Learning Control for Unmanned Driving Robot Vehicle

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Online Active Set-Based Longitudinal and Lateral Model Predictive Tracking Control of Electric Autonomous Driving

A method for vehicle speed tracking by controlling driving robot

Longitudinal Hierarchical Control of Autonomous Vehicle Based on Deep Reinforcement Learning and PID Algorithm

Real-Time Experimental Evaluation and Analysis of PID and MPC Controllers Using HIL Setup for Robust Steering System of Autonomous Vehicles

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Driver-Behavior-Based Adaptive Steering Robust Nonlinear Control of Unmanned Driving Robotic Vehicle with Modeling Uncertainties and Disturbance Observer

A Longitudinal/Lateral Coupled Neural Network Model Predictive Controller for Path Tracking of Self-Driving Vehicle

Research on Lateral and Longitudinal Coordinated Control of Distributed Driven Driverless Formula Racing Car under High-Speed Tracking Conditions

Output Feedback Nonlinear Adaptive Steering Control of Driving Robot Vehicle with Model Uncertainty

Neural Active Disturbance Rejection Adaptive Lateral Manipulation Control Method for Unmanned Driving Robot

Coordination Control Method of Longitudinal and Lateral Manipulation for Driving Robot

RHONN Modelling-enabled Nonlinear Predictive Control for Lateral Dynamics Stabilization of An In-wheel Motor Driven Vehicle

A Novel Robust H∞ Control Approach Based on Vehicle Lateral Dynamics for Practical Path Tracking Applications

Self-learning Path-Tracking Control of Autonomous Vehicles Using Kernel-Based Approximate Dynamic Programming

Reinforcement-learning-aided Adaptive Control for Autonomous Driving with Combined Lateral and Longitudinal Dynamics

A Novel Nonlinear Adaptive Control Method for Longitudinal Speed Control for Four-Independent-Wheel Autonomous Vehicles