Abstract:In this paper, we first introduce and define several new information divergences in the space of transition matrices of finite Markov chains which measure the discrepancy between two Markov chains. These divergences offer natural generalizations of classical information-theoretic divergences, such as the $f$-divergences and the Rényi divergence between probability measures, to the context of finite Markov chains. We begin by detailing and deriving fundamental properties of these divergences and notably gives a Markov chain version of the Pinsker's inequality and Chernoff information. We then utilize these notions in a few applications. First, we investigate the binary hypothesis testing problem of Markov chains, where the newly defined Rényi divergence between Markov chains and its geometric interpretation play an important role in the analysis. Second, we propose and analyze information-theoretic (Cesàro) mixing times and ergodicity coefficients, along with spectral bounds of these notions in the reversible setting. Examples of the random walk on the hypercube, as well as the connections between the critical height of the low-temperature Metropolis-Hastings chain and these proposed ergodicity coefficients, are highlighted.

Generalized Jarzynski'S Equality in Inhomogeneous Markov Chains

Generalized Jarzynski’s Equality of Inhomogeneous Multidimensional Diffusion Processes

The Invariance Principle for Some Class of Markov Chains

Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

The Generalized Entropy Ergodic Theorem for Nonhomogeneous Markov Chains

A Jarzynski-type equality for nonequilibrium steady-state probabilities

Modified Jarzynski equality in a microcanonical ensemble

Jarzynski's equality, fluctuation theorems, and variance reduction: Mathematical analysis and numerical algorithms

Hoeffding's Inequality for Markov Chains under Generalized Concentrability Condition

Jarzynski Equality, Crooks Fluctuation Theorem, and the Fluctuation Theorems of Heat for Arbitrary Initial States

Jarzynski equality for conditional stochastic work

Jarzynski matrix equality: calculating free energy difference by non-equilibrium simulations with an arbitrary initial distribution

Reversibility and Entropy Production of Inhomogeneous Markov Chains

Experimental Test of the Jarzynski Equality in a Single Spin-1 System Using High-Fidelity Single-Shot Readouts

Equivalences of Geometric Ergodicity of Markov Chains

Quantum Crooks Fluctuation Theorem and Quantum Jarzynski Equality in the Presence of a Reservoir

Hoeffding's lemma for Markov Chains and its applications to statistical learning

Cycle Symmetries and Circulation Fluctuations for Discrete-Time and Continuous-Time Markov Chains

Information divergences of Markov chains and their applications

A new expression of the probability distribution in incomplete statistics and fundamental thermodynamic relations