Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

Fault-tolerant tracking control based on reinforcement learning with application to a steer-by-wire system

Fault Diagnosis and Reconfigurable Control for Underwater Vehicles

Fault-Tolerant Control for Intelligent Electrified Vehicles Against Front Wheel Steering Angle Sensor Faults During Trajectory Tracking

Robust Fault Tolerant Path Tracking Control for Intelligent Vehicle under Steering System Faults

Metalearning-Based Fault-Tolerant Control for Skid Steering Vehicles under Actuator Fault Conditions

Adaptive robust control algorithm for enhanced path-tracking performance of automated driving in critical scenarios

A model predictive control approach for angle tracking of steer‐by‐wire system with nonlinear transmission ratio

Robust Steering Angle Tracking Control for Steer-by-wire System

Reinforcement Learning-Based Optimal Fault-Tolerant Tracking Control of Industrial Processes

Constrained Reinforcement Learning-Based Closed-Loop Reference Model for Optimal Tracking Control of Unknown Continuous-Time Systems

A Composite Internal Model Robust Control Strategy for an Automobile Steer-by-wire System

Fault-Tolerant Vehicle Stability Control Based on Active Steering and Direct Yaw Moment With Finite-Time Constraint Performance Recovery

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

Performance-Guaranteed Adaptive Optimized Control of Intelligent Surface Vehicle Using Reinforcement Learning

Realizing asynchronous finite-time robust tracking control of switched flight vehicles by using nonfragile deep reinforcement learning

Two-Dimensional Reinforcement Learning Model-Free Fault-Tolerant Control for Batch Processes Against Multi- Faults

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Fault-tolerant Adaptive Tracking Control of Euler-Lagrange Systems - an Echo State Network Approach Driven by Reinforcement Learning

Fault Tolerant Sliding Mode Predictive Control for Uncertain Steer-by-Wire System

Fault-Tolerant Control Architecture for Steering-by-Wire System

Event-triggered adaptive sliding mode control for steer-by-wire systems with actuator fault