Abstract:Given a target distribution $\pi$ and an arbitrary Markov infinitesimal generator $L$ on a finite state space $\mathcal{X}$, we develop three structured and inter-related approaches to generate new reversiblizations from $L$. The first approach hinges on a geometric perspective, in which we view reversiblizations as projections onto the space of $\pi$-reversible generators under suitable information divergences such as $f$-divergences. With different choices of functions $f$, we not only recover nearly all established reversiblizations but also unravel and generate new reversiblizations. Along the way, we unveil interesting geometric results such as bisection properties, Pythagorean identities, parallelogram laws and a Markov chain counterpart of the arithmetic-geometric-harmonic mean inequality governing these reversiblizations. This further serves as motivation for introducing the notion of information centroids of a sequence of Markov chains and to give conditions for their existence and uniqueness. Building upon the first approach, we view reversiblizations as generalized means. In this second approach, we construct new reversiblizations via different natural notions of generalized means such as the Cauchy mean or the dual mean. In the third approach, we combine the recently introduced locally-balanced Markov processes framework and the notion of convex $*$-conjugate in the study of $f$-divergence. The latter offers a rich source of balancing functions to generate new reversiblizations.

A Geometric Reduction Approach for Identity Testing of Reversible Markov Chains

Information Geometry of Reversible Markov Chains

Minimax Testing of Identity to a Reference Ergodic Markov Chain

Testing Symmetric Markov Chains from a Single Trajectory

Geometric Aspects of Data-Processing of Markov Chains

The Invariance Principle for Some Class of Markov Chains

A solution to the reversible embedding problem for finite Markov chains

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

Systematic approaches to generate reversiblizations of Markov chains

Reversible Mcmc on Markov Equivalence Classes of Sparse Directed Acyclic Graphs

Geometry and Duality of Alternating Markov Chains

Beyond Decisiveness of Infinite Markov Chains

Formal Error Bounds for the State Space Reduction of Markov Chains

Geometric Ergodicity and the Spectral Gap of Non-Reversible Markov Chains

Non-asymptotic Estimates for Markov Transition Matrices with Rigorous Error Bounds

On the $α$-lazy version of Markov chains in estimation and testing problems

Irreducibility of Recombination Markov Chains in the Triangular Lattice

A Markov Chain Approach to the Problem of Runs and Patterns

Irreducible Markov Chains on spaces of graphs with fixed degree-color sequences

Combinatorial Characterization of Exponential Families of Lumpable Stochastic Matrices

Hoeffding's lemma for Markov Chains and its applications to statistical learning