Abstract:We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the absorbing set is replaced by an optimal strong stationary time, representing the ``hitting time of the stationary distribution''. On the one hand, we show that our notion of quasi-stationary distribution corresponds to the natural generalization of the \emph{Yaglom limit}. On the other hand, similarly to the classical quasi-stationary distribution, we show that it can be written in terms of the eigenvectors of the underlying Markov kernel, and it is therefore amenable of a geometric interpretation. Moreover, we recover the usual exponential behavior that characterizes quasi-stationary distributions and metastable systems. We also provide some toy examples, which show that the phenomenology is richer compared to the absorbing case. Finally, we present some counterexamples, showing that the assumption on the reversibility cannot be weakened in general.
What problem does this paper attempt to address?
The core problem that this paper attempts to solve is: **Define and study the quasi - stationary distribution of reversible ergodic Markov chains in the absence of absorbing states**. Specifically, the author introduced a new concept of quasi - stationary distribution, which does not depend on the existence of absorbing states, but describes the process of the system approaching the stationary distribution through the optimal strong stationary time.
### Main problems and methods
1. **Define the quasi - stationary distribution**:
- Traditionally, the quasi - stationary distribution is defined as a conditional distribution in an absorbing Markov chain, that is, the distribution of the system given that the system has not been absorbed yet.
- This paper proposes a new concept of quasi - stationary distribution, which does not require the existence of absorbing states, but replaces the traditional "time of first hitting the absorbing state" with the optimal strong stationary time.
2. **Relationship with the Yaglom limit**:
- The author proved that the newly defined quasi - stationary distribution corresponds to the naturally generalized Yaglom limit. The Yaglom limit refers to the limit of the probability distribution of the system not being absorbed under long - time conditions.
3. **Spectral interpretation**:
- Similar to the classical quasi - stationary distribution, the new quasi - stationary distribution can also be represented by the eigenvectors of the Markov kernel, so it has a geometric interpretation.
- The author also showed that this distribution has the usual exponential behavior, which is consistent with the characteristics of the quasi - stationary distribution and metastable systems.
4. **Counterexamples and non - reversibility**:
- The author showed through counterexamples that in the non - reversible case, the newly defined Yaglom limit may not exist, and the conditional distribution may exhibit periodic behavior, implying the existence of more general attractors.
- Therefore, the extension to the study of non - reversible chains remains an open problem.
### Key formulas
- **Definition of the Yaglom limit**:
\[
\phi^\star_\alpha(y) := \lim_{t \to \infty} P_\alpha(X_t = y \mid \tau^\pi_\alpha > t), \quad y \in X
\]
where \(\tau^\pi_\alpha\) is the optimal strong stationary time starting from the initial distribution \(\alpha\).
- **Separation distance**:
\[
s^\alpha_t(y) := 1 - \frac{\mu^\alpha_t(y)}{\pi(y)}, \quad s^\alpha_t := \max_{y \in X} s^\alpha_t(y)
\]
- **Probability of the optimal strong stationary time**:
\[
P_\alpha(\tau^\pi_\alpha > t) = s^\alpha_t
\]
- **Recurrence formula for the conditional distribution**:
\[
\langle \phi^\alpha_t \mid - \langle \pi \mid = \frac{s^\alpha_0}{s^\alpha_t} \left( \langle \phi^\alpha_0 \mid P^t - \langle \pi \mid \right)
\]
### Conclusion
This paper successfully defined the quasi - stationary distribution in the absence of absorbing states by introducing the optimal strong stationary time, and proved its relationship with the Yaglom limit and its spectral interpretation. In addition, the author also explored the validity of this definition in the non - reversible case and proposed directions for future research.