Abstract:We propose a new risk-constrained formulation of the classical Linear Quadratic (LQ) stochastic control problem for general partially-observed systems. Our framework is motivated by the fact that the risk-neutral LQ controllers, although optimal in expectation, might be ineffective under relatively infrequent, yet statistically significant extreme events. To effectively trade between average and extreme event performance, we introduce a new risk constraint, which explicitly restricts the total expected predictive variance of the state penalty by a user-prescribed level. We show that, under certain conditions on the process noise, the optimal risk-aware controller can be evaluated explicitly and in closed form. In fact, it is affine relative to the minimum mean square error (mmse) state estimate. The affine term pushes the state away from directions where the noise exhibits heavy tails, by exploiting the third-order moment~(skewness) of the noise. The linear term regulates the state more strictly in riskier directions, where both the prediction error (conditional) covariance and the state penalty are simultaneously large; this is achieved by inflating the state penalty within a new filtered Riccati difference equation. We also prove that the new risk-aware controller is internally stable, regardless of parameter tuning, in the special cases of i) fully-observed systems, and ii) partially-observed systems with Gaussian noise. The properties of the proposed risk-aware LQ framework are lastly illustrated via indicative numerical examples.

Regret Analysis for Risk-aware Linear Quadratic Control

Regret and Conservatism of Distributionally Robust Constrained Stochastic Model Predictive Control

A Distributionally Robust Approach to Regret Optimal Control using the Wasserstein Distance

Wasserstein Distributionally Robust Regret-Optimal Control in the Infinite-Horizon

Infinite-Horizon Distributionally Robust Regret-Optimal Control

Regret Bounds for Episodic Risk-Sensitive Linear Quadratic Regulator

Wasserstein Distributionally Robust Regret-Optimal Control under Partial Observability

Regret Optimal Control for Uncertain Stochastic Systems

Closing the Gap to Quadratic Invariance: a Regret Minimization Approach to Optimal Distributed Control

Controlling Unknown Linear Dynamics with Almost Optimal Regret

Wasserstein Distributionally Robust Control of Partially Observable Linear Stochastic Systems

Learning Decentralized Linear Quadratic Regulators with [math] Regret

Discrete Distributionally Robust Optimal Control with Explicitly Constrained Optimization

Regret Analysis of Learning-Based MPC With Partially-Unknown Cost Function

Distributionally Robust Infinite-horizon Control: from a pool of samples to the design of dependable controllers

Linear Quadratic Control with Risk Constraints

Distributionally Robust Regret Minimization

Nonlinear Wasserstein Distributionally Robust Optimal Control

Quantitative Stability of Two-Stage Distributionally Robust Risk Optimization Problem with Full Random Linear Semi-Definite Recourse

A Distributionally Robust Optimization based Method for Stochastic Model Predictive Control

Data-Driven Distributionally Robust Optimal Control with State-Dependent Noise