Abstract:CVaR (Conditional value at risk) is a risk metric widely used in finance. However, dynamically optimizing CVaR is difficult, because it is not a standard Markov decision process (MDP) and the principle of dynamic programming fails. In this paper, we study the infinite‐horizon discrete‐time MDP with a long‐run CVaR criterion, from the view of sensitivity‐based optimization. By introducing a pseudo CVaR metric, we reformulate the problem as a bilevel MDP model and derive a CVaR difference formula which quantifies the difference of long‐run CVaR under any two policies. The optimality of deterministic policies is derived. We obtain a so‐called Bellman local optimality equation for CVaR, which is a necessary and sufficient condition for locally optimal policies and only necessary for globally optimal policies. A CVaR derivative formula is also derived for providing more sensitivity information. Then we develop a policy iteration type algorithm to efficiently optimize CVaR, which is shown to converge to a local optimum in mixed policy space. Furthermore, based on the sensitivity analysis of our bilevel MDP formulation and critical points, we develop a globally optimal algorithm. The piecewise linearity and segment convexity of the optimal pseudo CVaR function are also established. Our main results and algorithms are further extended to optimize the mean and CVaR simultaneously. Finally, we conduct numerical experiments relating to portfolio management to demonstrate the main results. Our work sheds light on dynamically optimizing CVaR from a sensitivity viewpoint. This article is protected by copyright. All rights reserved

DYNAMIC CVAR WITH MULTI-PERIOD RISK PROBLEMS

Optimal Multivariate Quota-Share Reinsurance: A Nonparametric Mean-Cvar Framework

Multi-period Portfolio Optimization under Possibility Measures

Risk‐sensitive markov decision processes with long‐run CVaR criterion

Multiperiod Portfolio Selection Models under Uncertain Measure and with Multiple Criteria

Multi-period Portfolio Optimization under Probabilistic Risk Measure

EP-CVaR Risk Measure Approach and Its Application in Portfolio Optimization

Multi-period Mean–semivariance Portfolio Optimization Based on Uncertain Measure

An Asymptotic CVaR Measure of Risk for Markov Chains

Dynamic Estimator of Duration at Risk Based on Quantile Autoregression Model

Multi-Period Mean-Variance Portfolio Optimization with High-Order Coupled Asset Dynamics

Dynamic Mean–Variance Portfolio Optimization with Value-at-Risk Constraint in Continuous Time

Dynamic Mean-LPM and Mean-CVaR Portfolio Optimization in Continuous-time

A novel probabilistic risk measure model for multi-period uncertain portfolio selection

Using genetic algorithm to solve a new multi-period stochastic optimization model

Analysis of Multi-period Combined Bidding of Power Suppliers Based on Weighted CVaR

Multi-Period Mean-Variance Portfolio Selection with Uncertain Time Horizon When Returns Are Serially Correlated

Study of the dynamic mean-variance portfolio optimization with regard to bankruptcy

Robust Portfolio Optimization with Respect to Spectral Risk Measures Under Correlation Uncertainty

The impact of model risk on dynamic portfolio selection under multi-period mean-standard-deviation criterion

Multi-period Portfolio Selection with Dynamic Risk/expected-Return Level under Fuzzy Random Uncertainty.