Optimal model for first arrival time distribution function and risk minimum model

Yuanlie Lin,Jianxing Lin
1996-01-01
Abstract:An optimal model for the arrival time distribution function (FATDF) (stochastic ordering) in discrete time with countable state and action space is investigated. Some sufficient and necessary conditions of existence of an optimal policy for FATDF are obtained. Several structures and properties of convex combinations and cut-and-piece together of optimal polices are described. It is shown that there is a unique solution for the optimal equations systems series. The algorithms to find all optimal policies and optimal values are given. The risk minimum model is presented and the relationships between it and the optimal model for FATDF are derived. Existence of an ��-optimal Markov policy for the finite horizon is verified. Such models arise in relation to resource-sharing systems, reliability, queueing systems, etc.
What problem does this paper attempt to address?