Abstract:We study the problem of \textit{safe control of linear dynamical systems corrupted with non-stochastic noise}, and provide an algorithm that guarantees (i) zero constraint violation of convex time-varying constraints, and (ii) bounded dynamic regret, \ie bounded suboptimality against an optimal clairvoyant controller that knows the future noise a priori. The constraints bound the values of the state and of the control input such as to ensure collision avoidance and bounded control effort. We are motivated by the future of autonomy where robots will safely perform complex tasks despite real-world unpredictable disturbances such as wind and wake disturbances. To develop the algorithm, we capture our problem as a sequential game between a linear feedback controller and an adversary, assuming a known upper bound on the noise's magnitude. Particularly, at each step $t=1,\ldots, T$, first the controller chooses a linear feedback control gain $K_t \in \calK_t$, where $\calK_t$ is constructed such that it guarantees that the safety constraints will be satisfied; then, the adversary reveals the current noise $w_t$ and the controller suffers a loss $f_t(K_t)$ -- \eg $f_t$ represents the system's tracking error at $t$ upon the realization of the noise. The controller aims to minimize its cumulative loss, despite knowing $w_t$ only after $K_t$ has been chosen. We validate our algorithm in simulated scenarios of safe control of linear dynamical systems in the presence of bounded noise

Stochastic Control of a Class of Dynamical Systems Via Path Limits

Feedback minimization of first-passage failure of quasi integrable Hamiltonian systems

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Impulsive Control of Stochastic Systems with Applications in Chaos Control, Chaos Synchronization, and Neural Networks

Stochastic Near-Optimal Controls for Path-Dependent Systems

Asymptotic Stability with Probability One of Random-Time-Delay-Controlled Quasi-Integrable Hamiltonian Systems

Safe Non-Stochastic Control of Linear Dynamical Systems

Stochastic control and non-equilibrium thermodynamics: fundamental limits

Pathwise Stochastic Control and a Class of Stochastic Partial Differential Equations

Limit theory for controlled McKean-Vlasov dynamics

Stochastic limit-cycle oscillations of a nonlinear system under random perturbations

Stochastic Control Barrier Functions with Bayesian Inference for Unknown Stochastic Differential Equations

A Robust Suppress Of Stochastic Nonlinear Systems With Markovian Jump Parameters

Ensemble Control of Stochastic Linear Systems

Approximate Controllability of Fully Nonlocal Stochastic Delay Control Problems Driven by Hybrid Noises

A Mini-Course on Stochastic Control

Mean-field limit for stochastic control problems under state constraint

Optimal control of infinite-dimensional differential systems with randomness and path-dependence and stochastic path-dependent Hamilton-Jacobi equations

Stochastic Weak Passivity for Weakly Stabilizing Stochastic Systems with Nonvanishing Noise

Discrete Control of Nonlinear Stochastic Systems Driven by Lévy Process

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds