1 TRANSIENT SOLUTIONS FOR MARKOV CHAINS

E. D. S. E. Silva,H. Gail
Abstract:1 DEFINITION OF TRANSIENT MEASURES Much of the theory developed for solving Markov chain models is devoted to obtaining steady state measures, that is, measures for which the observation interval (0, t) is “sufficiently large” (t → ∞). These measures are indeed approximations of the behavior of the system for a finite, but long, time interval, where long means with respect to the interval of time between occurrences of events in the system. However, an increasing number of applications requires the calculation of measures during a relatively “short” period of time. These are the so-called transient measures. In these cases the steady state measures
What problem does this paper attempt to address?