SUMS ARISING IN THE THEORY OF MARKOV CHAINS

S. Orey
DOI: https://doi.org/10.2307/2034375
Abstract:as N—>co, and also the behavior of some related sums. The sum (0.1) was first considered by Chung [l]. In special cases some results are known; we shall give detailed references to previous work in footnotes. Here we strengthen (0.0) by showing that the partial sums (0.1) are uniformly bounded above and below. In the ergodic aperiodic case and in certain null-recurrent cases convergence is demonstrated ; these results overlap some announced in [7]. It is shown that in the null-recurrent case (0.1) may fail to converge, thus settling a point raised in [l] and again in [7]; we hear C. Stone also has given counter-examples. The behavior of (0.1) and related sums has recently been shown to be of central importance for the development of a potential theory for certain recurrent Markov chains.4 We introduce some notation. Greek letters range over the state
What problem does this paper attempt to address?