Abstract:Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex optimization problems online, which leads to high computational burden and poor scalability. Reinforcement learning (RL) works well with complex systems, but pays the price of losing rigorous safety guarantee. This paper presents a theoretical framework that bridges the advantages of both RMPC and RL to synthesize safety filters for nonlinear systems with state- and action-dependent uncertainty. We decompose the robust invariant set (RIS) into two parts: a target set that aligns with terminal region design of RMPC, and a reach-avoid set that accounts for the rest of RIS. We propose a policy iteration approach for robust reach-avoid problems and establish its monotone convergence. This method sets the stage for an adversarial actor-critic deep RL algorithm, which simultaneously synthesizes a reach-avoid policy network, a disturbance policy network, and a reach-avoid value network. The learned reach-avoid policy network is utilized to generate nominal trajectories for online verification, which filters potentially unsafe actions that may drive the system into unsafe regions when worst-case disturbances are applied. We formulate a second-order cone programming (SOCP) approach for online verification using system level synthesis, which optimizes for the worst-case reach-avoid value of any possible trajectories. The proposed safety filter requires much lower computational complexity than RMPC and still enjoys persistent robust safety guarantee. The effectiveness of our method is illustrated through a numerical example.

Data-Driven Safety Filter: An Input-Output Perspective

A Finite-Time Safety Filter for Learning-Based Autonomous Driving

Safety Filters for Black-Box Dynamical Systems by Learning Discriminating Hyperplanes

Q-learning-based Model-free Safety Filter

A Robust, Efficient Predictive Safety Filter

Safe and Stable Adaptive Control for a Class of Dynamic Systems

The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems

Stability Mechanisms for Predictive Safety Filters

Domain Adaptive Safety Filters via Deep Operator Learning

Optimized Control Invariance Conditions for Uncertain Input-Constrained Nonlinear Control Systems

A Unified Framework for Online Data-Driven Predictive Control with Robust Safety Guarantees

Constraint-Guided Online Data Selection for Scalable Data-Driven Safety Filters in Uncertain Robotic Systems

Predictive Control Barrier Functions: Enhanced Safety Mechanisms for Learning-Based Control

Differentiable Predictive Control for Robotics: A Data-Driven Predictive Safety Filter Approach

Differentially Flat Learning-based Model Predictive Control Using a Stability, State, and Input Constraining Safety Filter

Learning Predictive Safety Filter via Decomposition of Robust Invariant Set

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Safe Online Dynamics Learning with Initially Unknown Models and Infeasible Safety Certificates

Safe adaptive output‐feedback optimal control of a class of linear systems

Conformal Predictive Safety Filter for RL Controllers in Dynamic Environments

Distributionally Robust Safety Filter for Learning-Based Control in Active Distribution Systems