Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

Robust Approximate Simulation for Hierarchical Control of Linear Systems under Disturbances

Approximate Stochastic Optimal Control for Linear Time Invariant Systems with Heavy-tailed Disturbances

Robust Adaptive Control for Robotic System with External Disturbance and Guaranteed Parameter Estimation

Compositional Construction of Approximate Abstractions of Interconnected Control Systems

An Approximate Optimal Control Approach for Robust Stabilization of a Class of Discrete-Time Nonlinear Systems with Uncertainties

Controlling Multivariable Systems with Significant Uncertainty

Hierarchical Distributed Control Design for Multi-agent Systems Using Approximate Simulation

Bayesian Formal Synthesis of Unknown Systems via Robust Simulation Relations

Compensator-based Approximate Optimal Control for Affine Nonlinear Systems with Input Constraints and Unmatched Disturbances.

Robust Control Barrier Functions using Uncertainty Estimation with Application to Mobile Robots

Scalable Robust Adaptive Control from the System Level Perspective

Approximate optimal control for an uncertain robot based on adaptive dynamic programming

Robust Bounded-H∞ Control for High-Order Fully Actuated Systems Based on FAS Approaches

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Robust H∞ control for structural systems with nonlinear perturbations and exogenous disturbances

Control of Large Model Mismatch Systems Using Multiple Models

Robust Nonlinear Optimal Control via System Level Synthesis

Robust Control and Simulation of Systems with Stochastic Perturbation

Robust Approximate Dynamic Programming for Nonlinear Systems With Both Model Error and External Disturbance

Robust stabilization of polytopic systems via fast and reliable neural network‐based approximations

Robust Safety-Critical Control for Dynamic Robotics