Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

A Two-Part Controller Synthesis Approach for Nonlinear Stochastic Systems Perturbed by Lévy Noise Using Renewal Theory and HJB-Based Impulse Control

A Controller-Design Method For Nonlinear-Systems Via A Staged-Transformation Technique

Two-Layer Asynchronous Control for a Class of Nonlinear Jump Systems: an Interval Segmentation Approach

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Finite-Time Control of Markov Jump Lur'e Systems with Singular Perturbations

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Impulsive Control of Stochastic Systems with Applications in Chaos Control, Chaos Synchronization, and Neural Networks

Discrete Control of Nonlinear Stochastic Systems Driven by Lévy Process

Formal Controller Synthesis for Markov Jump Linear Systems with Uncertain Dynamics

Predictive Control of Linear Discrete-Time Markovian Jump Systems by Learning Recurrent Patterns

Neural Lyapunov Control for Nonlinear Systems with Unstructured Uncertainties

Switching Controller Synthesis for Delay Hybrid Systems under Perturbations

Time-varying gain controller synthesis of piecewise homogeneous semi-Markov jump linear systems

Data-Driven Strategy Synthesis for Stochastic Systems with Unknown Nonlinear Disturbances

Robust data-driven learning and control of nonlinear systems. A Sontag's formula approach

Safe Non-Stochastic Control of Linear Dynamical Systems

Ensemble Control of Stochastic Linear Systems

Nonlinear Optimal Control for Stochastic Dynamical Systems

Designing System Level Synthesis Controllers for Nonlinear Systems with Stability Guarantees

Systematic, Lyapunov-Based, Safe and Stabilizing Controller Synthesis for Constrained Nonlinear Systems

A Stabilization Analysis for Highly Nonlinear Neutral Stochastic Delay Hybrid Systems with Superlinearly Growing Jump Coefficients by Variable-Delay Feedback Control