Abstract:We present a probabilistic formulation of risk aware optimal control problems for stochastic differential equations. Risk awareness is in our framework captured by objective functions in which the risk neutral expectation is replaced by a risk function, a nonlinear functional of random variables that accounts for the controller's risk preferences. We state and prove a risk aware minimum principle that gives necessary and sufficient conditions for optimality of generalized control processes taking values on probability measures defined on a given action space. We show that going from the risk neutral to the risk aware case, the minimum principle is modified by the introduction of one additional real-valued stochastic process that acts as a risk adjustment factor. This adjustment process is explicitly given as the expectation, conditional on the filtration at the given time, of an appropriately defined functional derivative of the risk function evaluated at the random total cost. The control model we employ differs from standard relaxed controls, and we elaborate on the differences, and benefits and drawbacks, of the control types; we further give conditions under which the generalized control can be realized using a strict control process. We present an application of the results for a portfolio allocation problem and show that the risk awareness of the objective function gives rise to a risk premium term that is characterized by the risk adjustment process described above. This suggests uses of our results in e.g. pricing of risk modeled by generic risk functions in financial applications.

Discrete time risk sensitive control problem

Robust Control For Singular Systems With State Delay And Parameter Uncertainty

Long Run Stochastic Control Problems with General Discounting

Discrete-Time Approximation of Risk-Averse Control Problems for Diffusion Processes

Risk-sensitive Markov control processes

Blackwell optimality and policy stability for long-run risk sensitive stochastic control

Risk-sensitive control of continuous time Markov chains

Risk-Averse Control of Undiscounted Transient Markov Models

On Average Risk-sensitive Markov Control Processes

Stability of long run functionals with respect to stationary Markov controls

Risk-Sensitivity Vanishing Limit for Controlled Markov Processes

Discrete-time risk sensitive portfolio optimization with proportional transaction costs

Linear Quadratic Control with Risk Constraints

Existence of Markov equilibrium control in discrete time

Risk-averse risk-constrained optimal control

Risk Aware Minimum Principle for Optimal Control of Stochastic Differential Equations

Duality Between Large Deviation Control and Risk-Sensitive Control for Markov Decision Processes.

Stochastic control of the Landau-Lifshitz-Gilbert equation

A theory of Markovian time-inconsistent stochastic control in discrete time

On the hierarchical risk-averse control problems for diffusion processes

Risk-Sensitive Stopping Problems for Continuous-Time Markov Chains