Abstract:We study the problem of \textit{safe control of linear dynamical systems corrupted with non-stochastic noise}, and provide an algorithm that guarantees (i) zero constraint violation of convex time-varying constraints, and (ii) bounded dynamic regret, \ie bounded suboptimality against an optimal clairvoyant controller that knows the future noise a priori. The constraints bound the values of the state and of the control input such as to ensure collision avoidance and bounded control effort. We are motivated by the future of autonomy where robots will safely perform complex tasks despite real-world unpredictable disturbances such as wind and wake disturbances. To develop the algorithm, we capture our problem as a sequential game between a linear feedback controller and an adversary, assuming a known upper bound on the noise's magnitude. Particularly, at each step $t=1,\ldots, T$, first the controller chooses a linear feedback control gain $K_t \in \calK_t$, where $\calK_t$ is constructed such that it guarantees that the safety constraints will be satisfied; then, the adversary reveals the current noise $w_t$ and the controller suffers a loss $f_t(K_t)$ -- \eg $f_t$ represents the system's tracking error at $t$ upon the realization of the noise. The controller aims to minimize its cumulative loss, despite knowing $w_t$ only after $K_t$ has been chosen. We validate our algorithm in simulated scenarios of safe control of linear dynamical systems in the presence of bounded noise

Small noise perturbations of stochastic ergodic control problems

Output Regulation Control for Stochastic Systems with Additive Noise.

Impulsive Control of Stochastic Systems with Applications in Chaos Control, Chaos Synchronization, and Neural Networks

Stochastic Control of a Class of Dynamical Systems Via Path Limits

Stochastic Near-Optimal Controls for Path-Dependent Systems

Safe Non-Stochastic Control of Linear Dynamical Systems

Relaxed optimal control for the stochastic Landau-Lifshitz-Bloch equation with jump noise

Stochastic Control of Metabolic Pathways

Large Deviation Minimisers for Stochastic Partial Differential Equations with Degenerate Noise

Stochastic near-optimal control: additive, multiplicative, non-Markovian and applications

Mean-square boundedness of stochastic networked control systems with bounded control inputs

Ensemble Control of Stochastic Linear Systems

Stochastic control and non-equilibrium thermodynamics: fundamental limits

Dynamic Programming of the Stochastic Burgers Equation Driven by Lévy Noise

Optimal control on finite graphs: asymptotic optimal controls and ergodic constant in the case of entropic costs

Optimal control of a linear system with multiplicative noise at control parameter

Optimal Bilinear Control of Nonlinear Stochastic Schrödinger Equations Driven by Linear Multiplicative Noise

Nonlinear SPDE driven by Levy noise: Well-posedness, optimal control and invariant measure

Optimal control problems in transport dynamics with additive noise

Exploring the Robustness of stabilizing controls for stochastic quantum evolutions

Exact Controllability of Discrete-Time Stochastic System with Multiplicative Noise