Abstract:Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex optimization problems online, which leads to high computational burden and poor scalability. Reinforcement learning (RL) works well with complex systems, but pays the price of losing rigorous safety guarantee. This paper presents a theoretical framework that bridges the advantages of both RMPC and RL to synthesize safety filters for nonlinear systems with state- and action-dependent uncertainty. We decompose the robust invariant set (RIS) into two parts: a target set that aligns with terminal region design of RMPC, and a reach-avoid set that accounts for the rest of RIS. We propose a policy iteration approach for robust reach-avoid problems and establish its monotone convergence. This method sets the stage for an adversarial actor-critic deep RL algorithm, which simultaneously synthesizes a reach-avoid policy network, a disturbance policy network, and a reach-avoid value network. The learned reach-avoid policy network is utilized to generate nominal trajectories for online verification, which filters potentially unsafe actions that may drive the system into unsafe regions when worst-case disturbances are applied. We formulate a second-order cone programming (SOCP) approach for online verification using system level synthesis, which optimizes for the worst-case reach-avoid value of any possible trajectories. The proposed safety filter requires much lower computational complexity than RMPC and still enjoys persistent robust safety guarantee. The effectiveness of our method is illustrated through a numerical example.

Predictive stability filters for nonlinear dynamical systems affected by disturbances

Stability Mechanisms for Predictive Safety Filters

Adaptive Extended State Space Predictive Control for a Kind of Nonlinear Systems.

Predictive Control Barrier Functions: Enhanced Safety Mechanisms for Learning-Based Control

Predictive control for nonlinear stochastic systems: Closed-loop guarantees with unbounded noise

A Robust, Efficient Predictive Safety Filter

Differentially Flat Learning-based Model Predictive Control Using a Stability, State, and Input Constraining Safety Filter

Asymptotic Stability of Controlled Nonlinear Stochastic Systems Considering the Dynamics of Sensors and Actuators

A Simple Model-Free Solution for Finite Control-Set Predictive Control in Power Converters

Robust adaptive control of uncertain nonlinear systems with unmodeled dynamics using command filter

A Non-Linear Offset-Free Model Predictive Control Design Approach

Characterization of the Dynamical Properties of Safety Filters for Linear Planar Systems

Stable Model Predictive Control Of Fuzzy Affine Systems With Input And State Constraints

Adaptive finite‐time stabilizing control of fractional‐order nonlinear systems with unmodeled dynamics via sampled‐data output‐feedback

Probabilistically Input-to-State Stable Stochastic Model Predictive Control

Predictive safety filter using system level synthesis

Learning Predictive Safety Filter via Decomposition of Robust Invariant Set

Sampling-based Stochastic Data-driven Predictive Control under Data Uncertainty

Data-Driven Safety Filter: An Input-Output Perspective

Dynamic Learning from Neural Network‐based Control for Sampled‐data Strict‐feedback Nonlinear Systems

Kernelized offset-free data-driven predictive control for nonlinear systems