Abstract:We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the absorbing set is replaced by an optimal strong stationary time, representing the ``hitting time of the stationary distribution''. On the one hand, we show that our notion of quasi-stationary distribution corresponds to the natural generalization of the \emph{Yaglom limit}. On the other hand, similarly to the classical quasi-stationary distribution, we show that it can be written in terms of the eigenvectors of the underlying Markov kernel, and it is therefore amenable of a geometric interpretation. Moreover, we recover the usual exponential behavior that characterizes quasi-stationary distributions and metastable systems. We also provide some toy examples, which show that the phenomenology is richer compared to the absorbing case. Finally, we present some counterexamples, showing that the assumption on the reversibility cannot be weakened in general.

Quasi-stationarity and Quasi-Ergodicity of General Markov Processes

Quasi-stationary distributions of non-absorbing Markov chains

On the quasi-ergodicity of absorbing Markov chains with unbounded transition densities, including random logistic maps with escape

Exponential and Strong Ergodicity for Markov Processes with an Application to Queues

Ergodic quasi-exchangeable stationary processes are isomorphic to Bernoulli processes

Existence and Uniqueness of Quasi-Stationary Distributions for Symmetric Markov Processes with Tightness Property

Markov Processes and Stochastic Extrinsic Derivative Flows on the Space of Absolutely Continuous Measures

Ergodicity for Q-Processes with Markovian Switching

Shift Ergodicity for Stationary Markov Processes

The Green–Kubo Formula for General Markov Processes with a Continuous Time Parameter

On absolute continuity of invariant measures associated with a piecewise-deterministic Markov processes with random switching between flows

A Remark on Quasi-Ergodicity of Ultracontractive Markov Processes

Lyapunov-type Conditions for Non-strong Ergodicity of Markov Processes

Subgeometric Rates of Convergence for a Class of Continuous-Time Markov Process

Stationary measures for stochastic differential equations with jumps

On the Existence and Uniqueness of Stationary Distributions for Some Piecewise Deterministic Markov Processes With State-Dependent Jump Intensity

Exponential Ergodicity for a Class of Markov Processes with Interactions

Quasi-stationary distributions for continuous-time $λ$-recurrent jump processes

Metastable Distributions of Semi-Markov Processes

Pointwise Stabilization of Discrete-time Stationary Matrix-valued Markovian Chains