Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

Path-Following Control for Self-driving Forklifts Based on Cascade Disturbance Rejection with Coordinates Reconstruction

Active Disturbance Rejection Path-following Control for Self- Driving Forklift Trucks with Geometry Based Feedforward

Steering Angle Control of Autonomous Vehicles Based on Active Disturbance Rejection Control

Integrated longitudinal and lateral control for autonomous vehicles with active load transfer strategy at the handling limits

A Hierarchical Anti-Disturbance Path Tracking Control Scheme for Autonomous Vehicles under Complex Driving Conditions.

An Autonomous Steering Approach Based on Linear Active Disturbance Rejection Control

Anti-rollover of the Counterbalanced Forklift Truck Based on Model Predictive Control

Path tracking coordinated control strategy for autonomous four in-wheel-motor independent-drive vehicles with consideration of lateral stability

Cascaded Steering Control Paradigm for the Lateral Automation of Heavy Commercial Vehicles

Trajectory Planning and Tracking for Four‐wheel Steering Vehicle Based on Differential Flatness and Active Disturbance Rejection Controller

Hierarchical Control for Path Tracking of Autonomous Vehicles

A Hierarchical Adaptive Control Framework of Path Tracking and Roll Stability for Intelligent Heavy Vehicle with MPC

Robust Composite Nonlinear Feedback Path-Following Control for Independently Actuated Autonomous Vehicles with Differential Steering

Nonlinear Model Predictive Path-Following Control with Steering Lag Compensation for Autonomous Vehicles

Linear Quadratic Regulator Based on Extended State Observer–based Active Disturbance Rejection Control of Autonomous Vehicle Path Following Control

Trajectory Tracking Collaborative Control of Autonomous Vehicle Based on Steering Stability

Integrated control of path tracking and handling stability for autonomous ground vehicles with four-wheel steering

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Adaptive Coordinated Path Tracking Control Strategy for Autonomous Vehicles with Direct Yaw Moment Control

A New Vehicle Path-Following Strategy of the Steering Driver Model Using General Predictive Control Method

Path tracking control of 4-wheel-steering autonomous ground vehicles based on linear parameter-varying system with experimental verification