Abstract:We present a probabilistic formulation of risk aware optimal control problems for stochastic differential equations. Risk awareness is in our framework captured by objective functions in which the risk neutral expectation is replaced by a risk function, a nonlinear functional of random variables that accounts for the controller's risk preferences. We state and prove a risk aware minimum principle that gives necessary and sufficient conditions for optimality of generalized control processes taking values on probability measures defined on a given action space. We show that going from the risk neutral to the risk aware case, the minimum principle is modified by the introduction of one additional real-valued stochastic process that acts as a risk adjustment factor. This adjustment process is explicitly given as the expectation, conditional on the filtration at the given time, of an appropriately defined functional derivative of the risk function evaluated at the random total cost. The control model we employ differs from standard relaxed controls, and we elaborate on the differences, and benefits and drawbacks, of the control types; we further give conditions under which the generalized control can be realized using a strict control process. We present an application of the results for a portfolio allocation problem and show that the risk awareness of the objective function gives rise to a risk premium term that is characterized by the risk adjustment process described above. This suggests uses of our results in e.g. pricing of risk modeled by generic risk functions in financial applications.

Discrete-Time Approximation of Risk-Averse Control Problems for Diffusion Processes

On the hierarchical risk-averse control problems for diffusion processes

Risk Aware Minimum Principle for Optimal Control of Stochastic Differential Equations

A Risk-Sensitive Stochastic Maximum Principle For Optimal Control Of Jump Diffusions And Its Applications

Robustness of Stochastic Optimal Control to Approximate Diffusion Models under Several Cost Evaluation Criteria

On Minimum-Dispersion Control of Nonlinear Diffusion Processes

On Average Risk-sensitive Markov Control Processes

Risk-sensitive Markov control processes

Analysis and approximation to parabolic optimal control problems with measure-valued controls in time

Stochastic control of optimized certainty equivalents

Stochastic Near-Optimal Controls for Path-Dependent Systems

Acceptable risks and related decision problems with multiple risk-averse agents

Risk-Averse Control of Markov Systems with Value Function Learning

On optimal control of reflected diffusions

A Stochastic Maximum Principle for Optimal Control of Jump Diffusions and Applications to Finance

Linear Quadratic Control with Risk Constraints

Optimal control of diffusion processes: $\infty$-order variational analysis and numerical solution

Parabolic PDE-constrained optimal control under uncertainty with entropic risk measure using quasi-Monte Carlo integration

Long Run Stochastic Control Problems with General Discounting

A Discount Vanishing Approximation for Markov Decision Processes with Risk Sensitivity