Abstract:Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex optimization problems online, which leads to high computational burden and poor scalability. Reinforcement learning (RL) works well with complex systems, but pays the price of losing rigorous safety guarantee. This paper presents a theoretical framework that bridges the advantages of both RMPC and RL to synthesize safety filters for nonlinear systems with state- and action-dependent uncertainty. We decompose the robust invariant set (RIS) into two parts: a target set that aligns with terminal region design of RMPC, and a reach-avoid set that accounts for the rest of RIS. We propose a policy iteration approach for robust reach-avoid problems and establish its monotone convergence. This method sets the stage for an adversarial actor-critic deep RL algorithm, which simultaneously synthesizes a reach-avoid policy network, a disturbance policy network, and a reach-avoid value network. The learned reach-avoid policy network is utilized to generate nominal trajectories for online verification, which filters potentially unsafe actions that may drive the system into unsafe regions when worst-case disturbances are applied. We formulate a second-order cone programming (SOCP) approach for online verification using system level synthesis, which optimizes for the worst-case reach-avoid value of any possible trajectories. The proposed safety filter requires much lower computational complexity than RMPC and still enjoys persistent robust safety guarantee. The effectiveness of our method is illustrated through a numerical example.

Safety Filter for Robust Disturbance Rejection via Online Optimization

Output Feedback Adaptive Robust Learning Control of a Class of Nonlinear Systems with Periodic Disturbances

Robust H∞ Filtering for a Class of Uncertain Lurie Time-delay Singular Systems

Robust Online Convex Optimization for Disturbance Rejection

Learning Predictive Safety Filter via Decomposition of Robust Invariant Set

A Robust, Efficient Predictive Safety Filter

Safety Filter Design for Neural Network Systems via Convex Optimization

Advanced safety filter based on SOS Control Barrier and Lyapunov Functions

Safe Non-Stochastic Control of Control-Affine Systems: An Online Convex Optimization Approach

RPCBF: Constructing Safety Filters Robust to Model Error and Disturbances via Policy Control Barrier Functions

Safe and Efficient Reinforcement Learning Using Disturbance-Observer-Based Control Barrier Functions

Online convex optimization for robust control of constrained dynamical systems

Optimized Control Invariance Conditions for Uncertain Input-Constrained Nonlinear Control Systems

Characterizing Smooth Safety Filters via the Implicit Function Theorem

Safe and Stable Filter Design Using a Relaxed Compatibitlity Control Barrier -- Lyapunov Condition

Nonlinear robust H-infinity filtering for a class of uncertain systems via convex optimization

Robust Nonlinear L2 Filtering of Uncertain Lipschitz Systems via Pareto Optimization

Iterative Convex Optimization for Model Predictive Control with Discrete-Time High-Order Control Barrier Functions

Learning Robust Safety Controllers for Uncertain Input-Affine Polynomial Systems

Constraint-Guided Online Data Selection for Scalable Data-Driven Safety Filters in Uncertain Robotic Systems

Adaptive Safety with a RISE-Based Disturbance Observer