Abstract:We propose a new risk-constrained formulation of the classical Linear Quadratic (LQ) stochastic control problem for general partially-observed systems. Our framework is motivated by the fact that the risk-neutral LQ controllers, although optimal in expectation, might be ineffective under relatively infrequent, yet statistically significant extreme events. To effectively trade between average and extreme event performance, we introduce a new risk constraint, which explicitly restricts the total expected predictive variance of the state penalty by a user-prescribed level. We show that, under certain conditions on the process noise, the optimal risk-aware controller can be evaluated explicitly and in closed form. In fact, it is affine relative to the minimum mean square error (mmse) state estimate. The affine term pushes the state away from directions where the noise exhibits heavy tails, by exploiting the third-order moment~(skewness) of the noise. The linear term regulates the state more strictly in riskier directions, where both the prediction error (conditional) covariance and the state penalty are simultaneously large; this is achieved by inflating the state penalty within a new filtered Riccati difference equation. We also prove that the new risk-aware controller is internally stable, regardless of parameter tuning, in the special cases of i) fully-observed systems, and ii) partially-observed systems with Gaussian noise. The properties of the proposed risk-aware LQ framework are lastly illustrated via indicative numerical examples.

Risk-Sensitive Stochastic Linear-Quadratic Optimal Control with Markov Jump Parameters

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Mean-field Stochastic Linear–quadratic Optimal Control with Markov Jump Parameters

Decentralized Stochastic Linear-Quadratic Optimal Control with Risk Constraint and Partial Observation

Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients and Markovian Regime Switching System

Linear Quadratic Control with Risk Constraints

Risk-sensitive control design for strict-feedback nonlinear stochastic systems with Markovian jump

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Linear Quadratic Optimal Control for Discrete-time Markov Jump Linear Systems.

Robust control for uncertain systems with time-delay and jump parameters*

A Stochastic Linear-Quadratic Optimal Control Problem with Jumps in an Infinite Horizon

Robust Stabilizability Based on SLQ Optimal Control for Systems with Markovian Jumping Parameters

Adaptive Linear Quadratic Gaussian Control of Markov Jump Linear Systems

Output-feedback Control for a Class of Markovian Jump Non-Linear Systems under a Risk-Sensitive Cost Criterion with Unknown Transition Probabilities

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Resilient Control for Nonlinear Markov Jump Systems with Incremental Quadratic Constraints

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

A Mean-Field Stochastic Linear-Quadratic Optimal Control Problem with Jumps under Partial Information

Robust quadratic control of discrete-time singular Markov jump systems with bounded transition probabilities

Uncertain optimal control of linear quadratic models with jump.