Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

Regional Control of Probabilistic Cellular Automata

Cellular Probabilistic Automata - A Novel Method for Uncertainty Propagation

Towards optimal control: the probabilistic route in quantum systems

On Pinning Reachability of Probabilistic Boolean Control Networks

Stationary measures and phase transition for a class of probabilistic cellular automata

Probabilistic Control and Majorization of Optimal Control

From certainty to chance: probabilistic insights into quantum control

Probabilistic Pathways: New Frontiers in Quantum Ensemble Control

Phase Transitions of Cellular Automata

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Quantum Systems from Random Probabilistic Automata

Control of Multistability Through Local Sensitivity Analysis: Application to Cellular Decision-Making Networks

Data-driven Interval MDP for Robust Control Synthesis

Complex dynamics of elementary cellular automata emerging from chaotic rules

A probabilistic framework for the control of systems with discrete states and stochastic excitation

Probabilistic Control for Uncertain Systems

A Control Approach for Nonlinear Stochastic State Uncertain Systems with Probabilistic Safety Guarantees

A computational framework for optimal and Model Predictive Control of stochastic gene regulatory networks

Sampling-Based Robust Control of Autonomous Systems with Non-Gaussian Noise

Locomotion control of distributed self-reconfigurable robot based on cellular automata

Cellular Automata: Temporal Stochasticity and Computability