Abstract:We study quasi-stationary distributions and quasi-limiting behavior of Markov chains in general reducible state spaces with absorption. We propose a set of assumptions dealing with particular situations where the state space can be decomposed into three subsets between which communication is only possible in a single direction. These assumptions allow us to characterize the exponential order of magnitude and the exact polynomial correction, called polynomial convergence parameter, for the leading order term of the semigroup for large time. They also provide explicit convergence speeds to this leading order term. We apply these results to general Markov chains with finitely or denumerably many communication classes using a specific induction over the communication classes of the chain. We are able to explicitely characterize the polynomial convergence parameter, to determine the complete set of quasistationary distributions and to provide explicit estimates for the speed of convergence to quasi-limiting distributions in the case of finitely many communication classes. We conclude with an application of these results to the case of denumerable state spaces, where we are able to prove that, in general, there is existence of a quasi-stationary distribution without assuming irreducibility before absorption. This actually holds true assuming only aperiodicity, the existence of a Lyapunov function and the existence of a point in the state space from which the return time is finite with positive probability.

Quasi-stationary distributions for continuous-time $λ$-recurrent jump processes

Delay-range-dependent and delay-distribution-independent stability criteria for discrete-time singular Markovian jump systems

Quasi-stationary distributions for single death processes with killing

Quasi-stationary distributions for time-changed symmetric $α$-stable processes killed upon hitting zero

Stochastic Stability Analysis for Discrete-Time Singular Markov Jump Systems with Time-Varying Delay and Piecewise-Constant Transition Probabilities

Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

On the Existence and Uniqueness of Stationary Distributions for Some Piecewise Deterministic Markov Processes With State-Dependent Jump Intensity

Stationary Response of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

H∞ Model Reduction for Discrete Singular Markovian Jump Systems

Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

Quasi-stationary distributions of non-absorbing Markov chains

Jump Markov models and transition state theory: the Quasi-Stationary Distribution approach

Quasi-stationary distributions in reducible state spaces

Representation and Characterization of Quasistationary Distributions for Markov Chains

Quasi-stationary distributions for subcritical branching Markov chains

Quasi-stationary distributions for the radial ornstein-uhlenbeck processes

Positive recurrence of piecewise Ornstein-Uhlenbeck processes and common quadratic Lyapunov functions

Quasistationarity and extinction for population processes

Quasi-stationary Distributions for Subcritical Superprocesses

The Distribution of Refracted Lévy Processes with Jumps Having Rational Laplace Transforms