Abstract:We study quasi-stationary distributions and quasi-limiting behavior of Markov chains in general reducible state spaces with absorption. We propose a set of assumptions dealing with particular situations where the state space can be decomposed into three subsets between which communication is only possible in a single direction. These assumptions allow us to characterize the exponential order of magnitude and the exact polynomial correction, called polynomial convergence parameter, for the leading order term of the semigroup for large time. They also provide explicit convergence speeds to this leading order term. We apply these results to general Markov chains with finitely or denumerably many communication classes using a specific induction over the communication classes of the chain. We are able to explicitely characterize the polynomial convergence parameter, to determine the complete set of quasistationary distributions and to provide explicit estimates for the speed of convergence to quasi-limiting distributions in the case of finitely many communication classes. We conclude with an application of these results to the case of denumerable state spaces, where we are able to prove that, in general, there is existence of a quasi-stationary distribution without assuming irreducibility before absorption. This actually holds true assuming only aperiodicity, the existence of a Lyapunov function and the existence of a point in the state space from which the return time is finite with positive probability.

About quasi-renewal processes and quasi-regenerative processes

Renewal and Regenerative Processes: short review

Quenched large deviations in renewal theory

Statistics of a Large Number of Renewals in Equilibrium and Non-Equilibrium Renewal Processes

Quasi-stationary distributions in reducible state spaces

Quasi-stationary distributions of non-absorbing Markov chains

A bound on the rate of convergence in the central limit theorem for renewal processes under second moment conditions

Non-equilibrium dynamics of stochastic point processes with refractoriness

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

A fractional generalization of the Poisson processes

The laws of iterated and triple logarithms for extreme values of regenerative processes

A Remark on Quasi-Ergodicity of Ultracontractive Markov Processes

Several Properties of a Nonstandard Renewal Counting Process and Their Applications

Replicating a renewal process at random times

Two-sided Bounds for Renewal Equations and Ruin Quantities

Refining quasi-probability kernels

Critical Branching Regenerative Processes with Migration

Non trivial limit distributions for transient renewal chains

Berry-Esseen estimates for regenerative processes under weak moment assumptions

Exponential and Pareto-type bounds for the renewal function and the excess lifetime of a renewal process

Quasi-stationary distributions for continuous-time $λ$-recurrent jump processes