Abstract:High-performance learning-based control for the typical safety-critical autonomous vehicles invariably requires that the full-state variables are constrained within the safety region even during the learning process. To solve this technically critical and challenging problem, this work proposes an adaptive safe reinforcement learning (RL) algorithm that invokes innovative safety-related RL methods with the consideration of constraining the full-state variables within the safety region with adaptation. These are developed toward assuring the attainment of the specified requirements on the full-state variables with two notable aspects. First, thus, an appropriately optimized backstepping technique and the asymmetric barrier Lyapunov function (BLF) methodology are used to establish the safe learning framework to ensure system full-state constraints requirements. More specifically, each subsystem's control and partial derivative of the value function are decomposed with asymmetric BLF-related items and an independent learning part. Then, the independent learning part is updated to solve the Hamilton-Jacobi-Bellman equation through an adaptive learning implementation to attain the desired performance in system control. Second, with further Lyapunov-based analysis, it is demonstrated that safety performance is effectively doubly assured via a methodology of a constrained adaptation algorithm during optimization (which incorporates the projection operator and can deal with the conflict between safety and optimization). Therefore, this algorithm optimizes system control and ensures that the full set of state variables involved is always constrained within the safety region during the whole learning process. Comparison simulations and ablation studies are carried out on motion control problems for autonomous vehicles, which have verified superior performance with smaller variance and better convergence performance under uncertain circumstances. The effectiveness of the safe performance of overall system control with the proposed method accordingly has been verified.

Runtime Safety Assurance for Learning-enabled Control of Autonomous Driving Vehicles

Runtime Assurance of Learning-Based Lane Changing Control for Autonomous Driving Vehicles

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Models

Safe Autonomous Driving with Latent Dynamics and State-Wise Constraints

Dynamic Simplex: Balancing Safety and Performance in Autonomous Cyber Physical Systems

The Black-Box Simplex Architecture for Runtime Assurance of Autonomous CPS

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Autonomous Driving Via Knowledge-Enhanced Safe Reinforcement Learning

Safe and efficient collision avoidance control for autonomous vehicles

A Verification Framework for Behavioral Safety of Self‐driving Cars

Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Making

Safe, Efficient, and Comfortable Autonomous Driving Based on Cooperative Vehicle Infrastructure System

Longitudinal control of automated vehicles: A novel approach by integrating deep reinforcement learning with intelligent driver model

Adaptive Safe Reinforcement Learning with Full-State Constraints and Constrained Adaptation for Autonomous Vehicles

Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Driving

Hierarchical Control Strategy Towards Safe Driving of Autonomous Vehicles

Explainable and Safe Reinforcement Learning for Autonomous Air Mobility

Safe-State Enhancement Method for Autonomous Driving Via Direct Hierarchical Reinforcement Learning.

Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety