Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

Data-Driven Abstractions for Control Systems via Random Exploration

Data-driven Interval MDP for Robust Control Synthesis

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Abstraction-based Control of Unknown Continuous-Space Models with Just Two Trajectories

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Data-driven abstraction-based control synthesis

Correct-by-Construction Control for Stochastic and Uncertain Dynamical Models via Formal Abstractions

A Stability-Based Abstraction Framework for Reach-Avoid Control of Stochastic Dynamical Systems with Unknown Noise Distributions

Robust Direct Data-Driven Control for Probabilistic Systems

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Symbolic Abstractions with Guarantees: A Data-Driven Divide-and-Conquer Strategy

Unifying Safety Approaches for Stochastic Systems: From Barrier Functions to Uncertain Abstractions via Dynamic Programming

Data-driven Construction of Finite Abstractions for Interconnected Systems: A Compositional Approach

Controller Design via Experimental Exploration with Robustness Guarantees

Dream to Explore: Adaptive Simulations for Autonomous Systems

Random Features Approximation for Control-Affine Systems

Sampling-Based Robust Control of Autonomous Systems with Non-Gaussian Noise

Smart abstraction based on iterative cover and non-uniform cells

Data-Driven Control of Large-Scale Networks with Formal Guarantees: A Small-Gain Free Approach

Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertainty

Leveraging Randomized Smoothing for Optimal Control of Nonsmooth Dynamical Systems