Abstract:Controllers for dynamical systems that operate in safety-critical settings must account for stochastic disturbances. Such disturbances are often modeled as process noise in a dynamical system, and common assumptions are that the underlying distributions are known and/or Gaussian. In practice, however, these assumptions may be unrealistic and can lead to poor approximations of the true noise distribution. We present a novel controller synthesis method that does not rely on any explicit representation of the noise distributions. In particular, we address the problem of computing a controller that provides probabilistic guarantees on safely reaching a target, while also avoiding unsafe regions of the state space. First, we abstract the continuous control system into a finite-state model that captures noise by probabilistic transitions between discrete states. As a key contribution, we adapt tools from the scenario approach to compute probably approximately correct (PAC) bounds on these transition probabilities, based on a finite number of samples of the noise. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP). This iMDP is, with a user-specified confidence probability, robust against uncertainty in the transition probabilities, and the tightness of the probability intervals can be controlled through the number of samples. We use state-of-the-art verification techniques to provide guarantees on the iMDP and compute a controller for which these guarantees carry over to the original control system. In addition, we develop a tailored computational scheme that reduces the complexity of the synthesis of these guarantees on the iMDP. Benchmarks on realistic control systems show the practical applicability of our method, even when the iMDP has hundreds of millions of transitions.

Controller Synthesis from Noisy-Input Noisy-Output Data

Controller synthesis for input-state data with measurement errors

Synthesis of guaranteed dissipation controller for uncertain time-delay systems

Controller Design for Asynchronous Multirate Sampled-Data Systems

Output feedback stabilization for a class of linear time-varying uncertain time-delay systems

Distributed Adaptive Controller for the Output-Synchronization of Networked Systems in Semi-Strict Feedback Form

Synchronised Output Regulation of Leader-Following Heterogeneous Networked Systems Via Error Feedback

A Decentralized Output Feedback Controller for a Class of Large-Scale Interconnected Nonlinear Systems

Data-driven control of nonlinear systems from input-output data

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Learning Control-Oriented Dynamical Structure from Data

SYNTHESIS OF THE STRONGLY POSITIVE REAL CONTROLLER WITH OUTPUT FEEDBACK FOR DISCRETE-TIME SYSTEMS

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Data-driven abstraction-based control synthesis

Designing System Level Synthesis Controllers for Nonlinear Systems with Stability Guarantees

Controller Synthesis for Linear Time-varying Systems with Adversaries

Sampled-Data Controller Synthesis using Dissipative Linear Periodic Jump-Flow Systems with Design Applications

Adaptive Event-triggered Control with Sampled Transmitted Output and Controller Dynamics

Output Feedback Controller Synthesis for Negative Imaginary Systems

Direct Data-Driven State-Feedback Control of Linear Parameter-Varying Systems

Data-driven harmonic output regulation of a class of nonlinear systems