Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

A Multi-Fidelity Bayesian Approach to Safe Controller Design

Safety-Aware Learning-Based Control of Systems with Uncertainty Dependent Constraints (extended version)

Confidence-Aware Safe and Stable Control of Control-Affine Systems

Safe Bayesian Optimization for Complex Control Systems via Additive Gaussian Processes

Risk-Informed Model-Free Safe Control of Linear Parameter-Varying Systems

Safe and Stable Control Synthesis for Uncertain System Models via Distributionally Robust Optimization

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

From a Single Trajectory to Safety Controller Synthesis of Discrete-Time Nonlinear Polynomial Systems

Safe Control Design through Risk-Tunable Control Barrier Functions

Learning Robust Safety Controllers for Uncertain Input-Affine Polynomial Systems

Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learning

A Control Approach for Nonlinear Stochastic State Uncertain Systems with Probabilistic Safety Guarantees

Provably Safe and Robust Learning-Based Model Predictive Control

Synthesis and verification of robust-adaptive safe controllers

Bayesian Learning-Based Adaptive Control for Safety Critical Systems

A Constructive Method for Designing Safe Multirate Controllers for Differentially-Flat Systems

Optimizing Falsification for Learning-Based Control Systems: A Multi-Fidelity Bayesian Approach

Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions

Safe Online Dynamics Learning with Initially Unknown Models and Infeasible Safety Certificates

Safe Non-Stochastic Control of Control-Affine Systems: An Online Convex Optimization Approach

Probabilistic Guarantees for Nonlinear Safety-Critical Optimal Control