Abstract:This paper presents a risk-informed data-driven safe control design approach for a class of stochastic uncertain nonlinear discrete-time systems. The nonlinear system is modeled using linear parameter-varying (LPV) systems. A model-based probabilistic safe controller is first designed to guarantee probabilistic -contractivity (i.e., stability and invariance) of the LPV system with respect to a given polyhedral safe set. To obviate the requirement of knowing the LPV system model and to bypass identifying its open-loop model, its closed-loop data-based representation is provided in terms of state and scheduling data as well as a decision variable. It is shown that the variance of the closed-loop system, as well as the probability of safety satisfaction, depends on the decision variable and the noise covariance. A minimum-variance direct data-driven gain-scheduling safe control design approach is presented next by designing the decision variable such that all possible closed-loop system realizations satisfy safety with the highest confidence level. This minimum-variance approach is a control-oriented learning method since it minimizes the variance of the state of the closed-loop system with respect to the safe set, and thus minimizes the risk of safety violation. Unlike the certainty-equivalent approach that results in a risk-neutral control design, the minimum-variance method leads to a risk-averse control design. It is shown that the presented direct risk-averse learning approach requires weaker data richness conditions than existing indirect learning methods based on system identification and can lead to a lower risk of safety violation. Two simulation examples along with an experimental validation on an autonomous vehicle are provided to show the effectiveness of the presented approach.

Safe control of nonlinear systems in LPV framework using model-based reinforcement learning

A Learning- and Scenario-based MPC Design for Nonlinear Systems in LPV Framework with Safety and Stability Guarantees.

Safe Deep Model-Based Reinforcement Learning with Lyapunov Functions

Model-free Control Design Using Policy Gradient Reinforcement Learning in LPV Framework

Look Before You Leap: Safe Model-Based Reinforcement Learning with Human Intervention

Safe Model-Based Reinforcement Learning for Systems with Parametric Uncertainties

Safe Interactive Model-Based Learning

Risk-Informed Model-Free Safe Control of Linear Parameter-Varying Systems

Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions

Verified Safe Reinforcement Learning for Neural Network Dynamic Models

Safe Reinforcement Learning via a Model-Free Safety Certifier

Reinforcement Learning for Safety-Critical Control under Model Uncertainty, using Control Lyapunov Functions and Control Barrier Functions

Safe Controller for Output Feedback Linear Systems using Model-Based Reinforcement Learning

Safe and Stable Closed-Loop Learning for Neural-Network-Supported Model Predictive Control

Safe Stabilization Control for Interconnected Virtual-Real Systems Via Model-based Reinforcement Learning

Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learning

Lifelong learning‐based multilayer neural network control of nonlinear continuous‐time strict‐feedback systems

Long short-term memory (LSTM) model-based reinforcement learning for nonlinear mass spring damper system control

End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control Tasks

Sampling-based Safe Reinforcement Learning for Nonlinear Dynamical Systems

Bayesian Learning-Based Adaptive Control for Safety Critical Systems