Abstract:High-performance learning-based control for the typical safety-critical autonomous vehicles invariably requires that the full-state variables are constrained within the safety region even during the learning process. To solve this technically critical and challenging problem, this work proposes an adaptive safe reinforcement learning (RL) algorithm that invokes innovative safety-related RL methods with the consideration of constraining the full-state variables within the safety region with adaptation. These are developed toward assuring the attainment of the specified requirements on the full-state variables with two notable aspects. First, thus, an appropriately optimized backstepping technique and the asymmetric barrier Lyapunov function (BLF) methodology are used to establish the safe learning framework to ensure system full-state constraints requirements. More specifically, each subsystem's control and partial derivative of the value function are decomposed with asymmetric BLF-related items and an independent learning part. Then, the independent learning part is updated to solve the Hamilton-Jacobi-Bellman equation through an adaptive learning implementation to attain the desired performance in system control. Second, with further Lyapunov-based analysis, it is demonstrated that safety performance is effectively doubly assured via a methodology of a constrained adaptation algorithm during optimization (which incorporates the projection operator and can deal with the conflict between safety and optimization). Therefore, this algorithm optimizes system control and ensures that the full set of state variables involved is always constrained within the safety region during the whole learning process. Comparison simulations and ablation studies are carried out on motion control problems for autonomous vehicles, which have verified superior performance with smaller variance and better convergence performance under uncertain circumstances. The effectiveness of the safe performance of overall system control with the proposed method accordingly has been verified.

A Harmonized Approach: Beyond-the-Limit Control for Autonomous Vehicles Balancing Performance and Safety in Unpredictable Environments

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Adaptive Safe Reinforcement Learning with Full-State Constraints and Constrained Adaptation for Autonomous Vehicles

Adaptive robust control algorithm for enhanced path-tracking performance of automated driving in critical scenarios

Autonomous Driving at the Handling Limit Using Residual Reinforcement Learning

A hybrid controller for safe and efficient longitudinal collision avoidance control

A hybrid controller for safe and efficient collision avoidance control

Autonomous Vehicle Extreme Control for Emergency Collision Avoidance Via Reachability-Guided Reinforcement Learning

Pay Attention to How You Drive: Safe and Adaptive Model-Based Reinforcement Learning for Off-Road Driving

Deep Adaptive Control: Deep Reinforcement Learning-Based Adaptive Vehicle Trajectory Control Algorithms for Different Risk Levels

A Finite-Time Safety Filter for Learning-Based Autonomous Driving

Integrated longitudinal and lateral control for autonomous vehicles with active load transfer strategy at the handling limits

REFINE: Reachability-Based Trajectory Design Using Robust Feedback Linearization and Zonotopes

Enhancing Safety in Nonlinear Systems: Design and Stability Analysis of Adaptive Cruise Control

Driver-automation Collaborative Steering Control for Intelligent Vehicles under Unexpected Emergency Conditions.

Finite-time Optimized Robust Control with Adaptive State Estimation Algorithm for Autonomous Heavy Vehicle

An Adaptive Control Framework for Mixed Autonomy Traffic Platoon

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

High-Speed Cornering Control and Real-Vehicle Deployment for Autonomous Electric Vehicles

Vehicle Extreme Control Based on Offline Reinforcement Leaning

Adaptive authority allocation-based driver-automation shared control for autonomous vehicles