Abstract:We propose a new risk-constrained formulation of the classical Linear Quadratic (LQ) stochastic control problem for general partially-observed systems. Our framework is motivated by the fact that the risk-neutral LQ controllers, although optimal in expectation, might be ineffective under relatively infrequent, yet statistically significant extreme events. To effectively trade between average and extreme event performance, we introduce a new risk constraint, which explicitly restricts the total expected predictive variance of the state penalty by a user-prescribed level. We show that, under certain conditions on the process noise, the optimal risk-aware controller can be evaluated explicitly and in closed form. In fact, it is affine relative to the minimum mean square error (mmse) state estimate. The affine term pushes the state away from directions where the noise exhibits heavy tails, by exploiting the third-order moment~(skewness) of the noise. The linear term regulates the state more strictly in riskier directions, where both the prediction error (conditional) covariance and the state penalty are simultaneously large; this is achieved by inflating the state penalty within a new filtered Riccati difference equation. We also prove that the new risk-aware controller is internally stable, regardless of parameter tuning, in the special cases of i) fully-observed systems, and ii) partially-observed systems with Gaussian noise. The properties of the proposed risk-aware LQ framework are lastly illustrated via indicative numerical examples.

Risk-sensitive state estimation for singular systems

Input and state estimation for linear systems: A least squares estimation approach

Robust State Estimation For Systems with Uncertainties of Unknown Bound

Robust State Estimation for Uncertain Linear Systems with Random Parametric Uncertainties

Sensitivity Penalization Based Robust State Estimation for Uncertain Linear Systems.

H∞ State Estimation for Discrete-Time Chaotic Systems Based on a Unified Model.

Robust State Estimation for Uncertain Linear Systems with Deterministic Input Signals

Novel Approach to Robust H_∞ State Estimation for Parametric Uncertainty

H∞ Model Reduction for Discrete Singular Markovian Jump Systems

Robust Stabilization for Uncertain Discrete Singular Systems with State Delay

H∞ Filtering for Discrete-Time Singular Systems with Randomly Occurring Delays and Sensor Failures

Robust State Estimation for Uncertain Discrete-Time Stochastic Systems with Missing Measurements

Linear Quadratic Control with Risk Constraints

A Discount Vanishing Approximation for Markov Decision Processes with Risk Sensitivity

Robust State Estimation Using Error Sensitivity Penalizing

On the Separation of Estimation and Control in Risk-Sensitive Investment Problems under Incomplete Observation

On the convergence of degenerate risk sensitive filters

Estimation of systems with statistically-constrained inputs

Risk-Sensitivity Vanishing Limit for Controlled Markov Processes

Robust State Estimation for Switched Systems with Unstable Subsystems

Solution to the risk-sensitive average cost optimality equation in a class of Markov decision processes with finite state space