Abstract:This article is concerned with the optimal control problem for the linear stochastic system $X_t=x+\int_0^t(A_sX_s+B_su_s+f_s)\, ds+\int_0^t\sum_{i=1}^d[C_i(s)X_s+D_i(s)u_s+g_i(s)]\, dw_i(s)$ with the convex risk functional $J(u)=EM(X_T)+E\int_0^TG(t, X_t,u_t)\, dt$. In order to guarantee the existence of an optimal control without any (weak) compactness assumption on the admissible control set, we assume that the risk function M is coercive and that $\sum_{i=1}^dD_i^*D_i$ is uniformly positive, rather than to assume like in the control literature that the running risk function G is coercive with respect to the control variable. In this new setting, the running risk function G may be independent of the control variable, and therefore the so-called singular linear-quadratic (LQ) stochastic control problem is included. A rigorous theory is developed for the general stochastic LQ problem with random coefficients, and the bounded mean oscillation--martingale theory is used to account for the concerned integrability. It plays a crucial role in the following exposition: (a) to connect the stochastic LQ problem to two associated backward stochastic differential equations (BSDEs)---one is an n × n symmetric matrix-valued nonlinear Riccati BSDE and the other is an n -dimensional linear BSDE with unbounded coefficients; (b) to show that the latter BSDE has an adapted solution pair of the suitably necessary regularity. This seems to be the first application in a stochastic LQ theory of the BMO-martingale theory, which roots in harmonic analysis. Furthermore, with the help of an a priori estimate on the risk functional, existence and uniqueness of the solutions of backward stochastic Riccati differential equations (BSRDEs) in the singular case is reduced to the regular case via a perturbation method, and then a new existence and uniqueness result on BSRDEs is obtained for the singular case.

Uniform Ergodicity and Ergodic-Risk Constrained Policy Optimization

Linear Quadratic Control with Risk Constraints

Risk-Constrained Linear-Quadratic Regulators

Risk-Constrained Control of Mean-Field Linear Quadratic Systems

Infinite-horizon Risk-constrained Linear Quadratic Regulator with Average Cost

Robust Reinforcement Learning for Risk-Sensitive Linear Quadratic Gaussian Control

Risk-Sensitive Stochastic Linear-Quadratic Optimal Control with Markov Jump Parameters

On the Volatility of Optimal Control Policies and the Capacity of a Class of Linear Quadratic Regulators

State-Output Risk-Constrained Quadratic Control of Partially Observed Linear Systems

Risk-sensitive Affine Control Synthesis for Stationary LTI Systems

Risk Sensitive, Nonlinear Optimal Control: Iterative Linear Exponential-Quadratic Optimal Control with Gaussian Noise

Policy Optimization for $\mathcal{H}_2$ Linear Control with $\mathcal{H}_\infty$ Robustness Guarantee: Implicit Regularization and Global Convergence

Primal-dual Learning for the Model-free Risk-constrained Linear Quadratic Regulator

Decentralized Stochastic Linear-Quadratic Optimal Control with Risk Constraint and Partial Observation

Minimization of Risk and Linear Quadratic Optimal Control Theory.

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

Tail-Constraining Stochastic Linear-Quadratic Control: Large Deviation and Statistical Physics Approach

Risk-Aware Constrained Reinforcement Learning with Non-Stationary Policies.

REPRESENTATION FORMULAS FOR LIMIT VALUES OF LONG RUN STOCHASTIC OPTIMAL CONTROLS

Robust affine control of linear stochastic systems