Abstract:The path tracking control system is a crucial component for autonomous vehicles; it is challenging to realize accurate tracking control when approaching a wide range of uncertain situations and dynamic environments, particularly when such control must perform as well as, or better than, human drivers. While many methods provide state-of-the-art tracking performance, they tend to emphasize constant PID control parameters, calibrated by human experience, to improve tracking accuracy. A detailed analysis shows that PID controllers inefficiently reduce the lateral error under various conditions, such as complex trajectories and variable speed. In addition, intelligent driving vehicles are highly non-linear objects, and high-fidelity models are unavailable in most autonomous systems. As for the model-based controller (MPC or LQR), the complex modeling process may increase the computational burden. With that in mind, a self-optimizing, path tracking controller structure, based on reinforcement learning, is proposed. For the lateral control of the vehicle, a steering method based on the fusion of the reinforcement learning and traditional PID controllers is designed to adapt to various tracking scenarios. According to the pre-defined path geometry and the real-time status of the vehicle, the interactive learning mechanism, based on an RL framework (actor–critic—a symmetric network structure), can realize the online optimization of PID control parameters in order to better deal with the tracking error under complex trajectories and dynamic changes of vehicle model parameters. The adaptive performance of velocity changes was also considered in the tracking process. The proposed controlling approach was tested in different path tracking scenarios, both the driving simulator platforms and on-site vehicle experiments have verified the effects of our proposed self-optimizing controller. The results show that the approach can adaptively change the weights of PID to maintain a tracking error (simulation: within ±0.071 m; realistic vehicle: within ±0.272 m) and steering wheel vibration standard deviations (simulation: within ±0.04°; realistic vehicle: within ±80.69°); additionally, it can adapt to high-speed simulation scenarios (the maximum speed is above 100 km/h and the average speed through curves is 63–76 km/h).

An RL-Based Path Tracking Control Strategy with Rollover Prevention and Safety Enhancement for the Autonomous Truck

Rollover Prevention and Motion Planning for an Intelligent Heavy Truck

Anti-rollover Artificial Potential Field Motion Planning Method of an Autonomous Heavy Truck Optimised by Game Theory

Perceptual Interaction-Based Path Tracking Control of Autonomous Vehicles under DoS Attacks: A Reinforcement Learning Approach

Trajectory Planning of Autonomous Trucks for Collision Avoidance With Rollover Prevention

Local Trajectory Planning for Autonomous Trucks in Collision Avoidance Maneuvers with Rollover Prevention

Autonomous driving of trucks in off-road environment

Fuzzy Adaptive Event-Triggered Path Tracking Control for Autonomous Vehicles Considering Rollover Prevention and Parameter Uncertainty

Reference Governor-Based Control for Active Rollover Avoidance of Mobile Robots

Integrated longitudinal and lateral control for autonomous vehicles with active load transfer strategy at the handling limits

A layered roll stability control strategy for commercial vehicles based on adaptive model predictive control

Anti-rollover Motion Planning for Automated Heavy Trucks

Self-Optimizing Path Tracking Controller for Intelligent Vehicles Based on Reinforcement Learning

Research on Path Tracking and Yaw Stability Coordination Control Strategy for Four-Wheel Independent Drive Electric Trucks

Path Planning and Obstacle Avoidance Control for Autonomous Multi-Axis Distributed Vehicle Based on Dynamic Constraints

Anti-Rollover Control and HIL Verification for an Independently Driven Heavy Vehicle Based on Improved LTR

A Hierarchical Adaptive Control Framework of Path Tracking and Roll Stability for Intelligent Heavy Vehicle with MPC

A path planning and path-following control framework for a general 2-trailer with a car-like tractor

Lateral safety evaluation of autonomous trucks in overtaking maneuvers and adverse weather: Exploratory comparison of different lateral control modes

Integrated Vehicle Controller for Path Tracking with Rollover Prevention of Autonomous Articulated Electric Vehicle Based on Model Predictive Control