Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

Visual Path Tracking Control for Park Scene

Predictive Control Method of Autonomous Vehicle Based on Tracking-error Model

Nonlinear Model Predictive Path Tracking Control for Autonomous Vehicles Based on Orthogonal Collocation Method

An Adaptive-PID Path Tracking Algorithm Based on High Accuracy Driving Map for an Autonomous Vehicle

Fuzzy PD Controller Based Path Tracking for Autonomous Vehicle under i-VICS

Driverless Simulation of Path Tracking Based on PID Control

Efficient Path Planning and Tracking Control of Autonomous Vehicles in Park Scenarios Based on Sparrow Search and Stepwise Prediction

Path Planning and Robust Path Tracking Control of an Automated Parallel Parking Maneuver

Path Planning and Tracking for Vehicle Parallel Parking Based on Preview BP Neural Network PID Controller

Path Tracking of Autonomous Vehicle Based on Adaptive Preview Trajectory Planning with the Consideration of Vehicle Stability

A Novel Robust H∞ Control Approach Based on Vehicle Lateral Dynamics for Practical Path Tracking Applications

An adaptive fuzzy-sliding lateral control strategy of automated vehicles based on vision navigation

Autonomous Parking Path Tracking Control Based on Interference Suppression

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Parking Robot Path-Tracking System Based on Discrete PID Algorithm

Research on Path Planning and Tracking Control of Automatic Parking System

Design, Analysis, and Experiments of Preview Path Tracking Control for Autonomous Vehicles.

Online Active Set-Based Longitudinal and Lateral Model Predictive Tracking Control of Electric Autonomous Driving

Perception, Planning and Control for Self-Driving System Based on On-board Sensors

The Lateral Tracking Control for the Intelligent Vehicle Based on Adaptive PID Neural Network

Receding Horizon Control for Lane Tracking of Intelligent Vehicles