Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

On a Theory of Precise Neural Control in a Noisy System

Achieving Precise Mechanical Control in Intrinsically Noisy Systems

Impulsive Control of Stochastic Systems with Applications in Chaos Control, Chaos Synchronization, and Neural Networks

Control of stationary probability density of nonlinear systems subject to Poisson white noise excitation

Some Challenging Problems in Research on Control Theory

Stochastic Minimax Vibration Control for Uncertain Nonlinear Quasi-Hamiltonian Systems with Noisy Observations

Controlling Precise Movement with Stochastic Signals

Optimal control of a linear system with multiplicative noise at control parameter

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system

Human motor learning is robust to control-dependent noise

A Note on Minimum-Variance Theory and Beyond

Exact Controllability of Discrete-Time Stochastic System with Multiplicative Noise

Optimal Control of Neuronal Activity

A Novel Framework for Backstepping-Based Control of Discrete-Time Strict-Feedback Nonlinear Systems With Multiplicative Noises

Safe Non-Stochastic Control of Control-Affine Systems: An Online Convex Optimization Approach

Safe Non-Stochastic Control of Linear Dynamical Systems

Optimal control of a Wilson-Cowan model of neural population dynamics.

Mitigating controller noise in quantum gates using optimal control theory

Characterization of Control Noise Effects in Optimal Quantum Unitary Dynamics

Noise-based control of opinion dynamics