Optimal Models for the First Arrival Time Distribution Function in Continuous Time — with a Special Case

Lin Yuanlie,R. J. Tomkins,Chunglie Wang
DOI: https://doi.org/10.1007/bf02006119
1994-01-01
Acta Mathematicae Applicatae Sinica
Abstract:Optimal Models for first arrival time (τ H ) and first arrival target total return (W H ) distribution functions on MDP in continuous time are presented. Asymptotic expansions of τ H andW H are derived and expressed in simple, explicit forms, and some of their properties are discussed. Two methods to find an optimal policy for distribution function of τ H are given. Several necessary and sufficient conditions for the existence of the optimal policy are obtained. This result leads to that the scope of finding the optimal policy is greatly reduced. A special case is also discussed and some deep results are given.
What problem does this paper attempt to address?