A Risk Minimization Problem for Finite Horizon Semi-Markov Decision Processes with Loss Rates

Qiuli Liu,Xiaolong Zou
DOI: https://doi.org/10.3934/jdg.2018009
2018-01-01
Abstract:This paper deals with the risk probability for finite horizon semi-Markov decision processes with loss rates. The criterion to be minimized is the risk probability that the total loss incurred during a finite horizon exceed a loss level. For such an optimality problem, we first establish the optimality equation, and prove that the optimal value function is a unique solution to the optimality equation. We then show the existence of an optimal policy, and develop a value iteration algorithm for computing the value function and optimal policies. We also derive the approximation of the value function and the rules of iteration. Finally, a numerical example is given to illustrate our results.
What problem does this paper attempt to address?