Abstract:High-performance learning-based control for the typical safety-critical autonomous vehicles invariably requires that the full-state variables are constrained within the safety region even during the learning process. To solve this technically critical and challenging problem, this work proposes an adaptive safe reinforcement learning (RL) algorithm that invokes innovative safety-related RL methods with the consideration of constraining the full-state variables within the safety region with adaptation. These are developed toward assuring the attainment of the specified requirements on the full-state variables with two notable aspects. First, thus, an appropriately optimized backstepping technique and the asymmetric barrier Lyapunov function (BLF) methodology are used to establish the safe learning framework to ensure system full-state constraints requirements. More specifically, each subsystem's control and partial derivative of the value function are decomposed with asymmetric BLF-related items and an independent learning part. Then, the independent learning part is updated to solve the Hamilton-Jacobi-Bellman equation through an adaptive learning implementation to attain the desired performance in system control. Second, with further Lyapunov-based analysis, it is demonstrated that safety performance is effectively doubly assured via a methodology of a constrained adaptation algorithm during optimization (which incorporates the projection operator and can deal with the conflict between safety and optimization). Therefore, this algorithm optimizes system control and ensures that the full set of state variables involved is always constrained within the safety region during the whole learning process. Comparison simulations and ablation studies are carried out on motion control problems for autonomous vehicles, which have verified superior performance with smaller variance and better convergence performance under uncertain circumstances. The effectiveness of the safe performance of overall system control with the proposed method accordingly has been verified.

Lane-keeping Control of Autonomous Vehicles Using Reinforcement Learning and Predictive Safety Filter *

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

A Finite-Time Safety Filter for Learning-Based Autonomous Driving

A Deep Reinforcement Learning Strategy for Surrounding Vehicles-Based Lane-Keeping Control

Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles

Path tracking control based on Deep reinforcement learning in Autonomous driving

Adept Guide and Guard Reinforcement Learning for Safe Driving in Lane-Keeping Scenarios

Design and Experiments of Safeguard Protected Preview Lane Keeping Control for Autonomous Vehicles

Lane Detection and Trajectory Tracking Control of Autonomous Vehicle Based on Model Predictive Control

ReinforcementDriving: Exploring Trajectories and Navigation for Autonomous Vehicles

Novel Dual‐layer‐oriented Strategy for Fully Automated Vehicles’ Lane‐keeping System

Safe reinforcement learning for autonomous vehicles to make lane-change decisions: Constraint based on Incomplete Information Game Theory

Adaptive Safe Reinforcement Learning with Full-State Constraints and Constrained Adaptation for Autonomous Vehicles

Lane Departure Prediction Based on Closed-Loop Vehicle Dynamics

Intelligent Vehicle Decision-Making and Trajectory Planning Method Based on Deep Reinforcement Learning in the Frenet Space

A Deep Reinforcement Learning-Based Approach for Autonomous Lane-Changing Velocity Control in Mixed Flow of Vehicle Group Level

A Lane Changing Model of Automatic Driving Vehicle Based on Reinforcement Learning.

Reinforcement Learning from Human Feedback for Lane Changing of Autonomous Vehicles in Mixed Traffic

Virtual Fluid-Flow-Model-Based Lane-Keeping Integrated With Collision Avoidance Control System Design for Autonomous Vehicles

Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

Lane Change Control for Self-Driving Vehicle Based on Model Predictive Control Considering the Instability of Sensor Detection