Exponential Convergence Rate in Entropy

Mu-Fa Chen

DOI: https://doi.org/10.1007/s11464-007-0022-5

2007-01-01

Frontiers of Mathematics in China

Abstract:The exponential convergence rate in entroy is studied for symmetric forms, with a special attention to the Markov chain with a state space having two points only. Some upper and lower bounds of the rate are obtained and five examples with precise or qualitatively exact estimates are presented.

What problem does this paper attempt to address?

A Supplement to the Complete Convergence

WD Liu,ZY Lin

DOI: https://doi.org/10.1016/j.spl.2005.10.006

IF: 0.718

2006-01-01

Statistics & Probability Letters

Abstract:Let X,X1,X2,… be independent identically distributed random variables. Then, Baum and Katz [1965. Convergence rates in the law of large numbers. Trans. Amer. Math. Soc. 120, 108–123] proved that for p>1,∑k=1∞kp-2P(|Sk|⩾k)<∞,if and only if E|X|p<∞ and EX=0. We prove thatf(n)≔∑k=1nkp-2P(|Sk|⩾k)is slowly varying asn→∞,if and only if EX=0 and E|X|pI{|X|⩽x} is slowly varying as x→∞.
THE EXPONENTIAL CONVERGENCE RATE OF THE SHANNON ENTROPY RATE OF COUNTABLE HOMOGENEOUS MARKOV CHAINS

HAO Ruili,YANG Weiguo,LI Rui

2010-01-01

Abstract:In this paper,the convergence rate of the Shannon entropy rate of certain countable homogeneous Markov chain is investigated by using Markov inequality and some properties of expectation,strong ergodicity and delta coefficient,in which the technique in Chang is applied.The obtained results generalize the corresponding results given by Chang.
Equivalence of exponential ergodicity and L2-exponential convergence for Markov chains

Mu-Fa Chen

DOI: https://doi.org/10.1016/S0304-4149(99)00114-3

IF: 1.43

2000-01-01

Stochastic Processes and their Applications

Abstract:This paper studies the equivalence of exponential ergodicity and L-2-exponential convergence mainly for continuous-time Markov chains. In the reversible case, we show that the known criteria for exponential ergodicity are also criteria for L-2-exponential convergence. Until now, no criterion for L-2-exponential convergence has appeared in the literature. Some estimates for the rate of convergence of exponentially ergodic Markov chains are presented. These estimates are practical once the stationary distribution is known. Finally, the reversible part of the main result is extended to the Markov processes with general state space. (C) 2000 Elsevier Science B.V. All rights reserved.
Exponential Convergence Rates for Markov Processes with Markovian Switching

Xi Fubao

2009-01-01

Acta Mathematica Scientia

Abstract:Let(X(t),Z(t)) be a strong Markov process with the phase space[0,∞)×{1,2,…, n_0} such that the first component X(t) depends on the second component Z(t) which is a Markov chain.Using the coupling methods,the author evaluates the exponential convergence rates of the transition probability of(X(t),Z(t)) to its invariant probability measure in total variation norm.
Asymptotic rates of convergence for compact reversible Markov chains

Yue Xu,Xiuwu Zhu

2023-08-04

Abstract:In this paper, we establish the main term governing the rate at which a compact reversible Markov chain converges to stationarity. As an application, we obtain the sharpest estimates for the corank distributions of uniform, skew centrosymmetric, symmetric, skew-symmetric, and Hermitian matrices.

Probability,Number Theory
Exponential Convergence in Entropy and Wasserstein for McKean–Vlasov SDEs

Panpan Ren,Feng-Yu Wang

DOI: https://doi.org/10.1016/j.na.2021.112259

2021-01-01

Abstract:The following type of exponential convergence is proved for (non-degenerate or degenerate) McKean-Vlasov SDEs: W-2(mu(t), mu(infinity))(2) + Ent(mu(t)vertical bar mu(infinity)) <= ce(-lambda t) min{W-2(mu(0), mu(infinity))(2), Ent(mu(0)vertical bar mu(infinity))}, t >= 1, where c, lambda > 0 are constants, mu(t) is the distribution of the solution at time t, mu(infinity) is the unique invariant probability measure, Ent is the relative entropy and W-2 is the L-2-Wasserstein distance. In particular, this type of exponential convergence holds for some (non-degenerate or degenerate) granular media type equations generalizing those studied in Carrillo et al. (2003) and Guillin et al. (0000) on the exponential convergence in a mean field entropy. (c) 2021 Elsevier Ltd. All rights reserved.
Rates of Convergence for Chains of Expansive Markov Operators

Neal Hermer,D. Russell Luke,Anja Sturm

2023-10-31

Abstract:We provide conditions that guarantee local rates of convergence in distribution of iterated random functions that are not nonexpansive mappings in locally compact Hadamard spaces. Our results are applied to stochastic instances of common algorithms in optimization, stochastic tomography for X-FEL imaging, and a stochastic algorithm for the computation of Fréchet means in model spaces for phylogenetic trees.

Probability,Optimization and Control
Exponential Convergence in Entropy and Wasserstein Distance for McKean-Vlasov SDEs

Panpan Ren,Feng-Yu Wang

2024-09-28

Abstract:The following type exponential convergence is proved for (non-degenerate or degenerate) McKean-Vlasov SDEs: $$W_2(\mu_t,\mu_\infty)^2 +{\rm Ent}(\mu_t|\mu_\infty)\le c {\rm e}^{-\lambda t} \min\big\{W_2(\mu_0, \mu_\infty)^2,{\rm Ent}(\mu_0|\mu_\infty)\big\},\ \ t\ge 1,$$ where $c,\lambda>0$ are constants, $\mu_t$ is the distribution of the solution at time $t$, $\mu_\infty$ is the unique invariant probability measure, ${\rm Ent}$ is the relative entropy and $W_2$ is the $L^2$-Wasserstein distance. In particular, this type exponential convergence holds for some (non-degenerate or degenerate) granular media type equations generalizing those studied in [CMV, GLW] on the exponential convergence in a mean field entropy.

Probability
Exponential<Emphasis Type="Italic">L</Emphasis><Superscript>2</Superscript>-convergence and<Emphasis Type="Italic">L</Emphasis><Superscript>2</Superscript>-spectral gap for Markov processes

Chen Mufa,Markov Processes

DOI: https://doi.org/10.1007/BF02582989

1991-01-01

Acta Mathematica Sinica

Abstract:This paper deals with the exponentialL 2-convergence for jump processes. We introduce some reduction methods and improve some previous results. Then we prove that for birth-death processes, exponentialL 2-convergence coincides indeed with exponential ergodicity which is widely studied in the Markov chain theory.
Convergence Rates of Markov Chains on Spaces of Partitions

Harry Crane,Steven P. Lalley

DOI: https://doi.org/10.48550/arXiv.1209.4918

2012-09-22

Abstract:We study the convergence rate to stationarity for a class of exchangeable partition-valued Markov chains called cut-and-paste chains. The law governing the transitions of a cut-and-paste chain are determined by products of i.i.d. stochastic matrices, which describe the chain induced on the simplex by taking asymptotic frequencies. Using this representation, we establish upper bounds for the mixing times of ergodic cut-and-paste chains, and under certain conditions on the distribution of the governing random matrices we show that the "cutoff phenomenon" holds.

Probability
Estimate the Exponential Convergence Rate of F-Ergodicity Via Spectral Gap

Xianping Guo,Zhong-Wei Liao

DOI: https://doi.org/10.1016/j.spl.2020.108924

IF: 0.718

2021-01-01

Statistics & Probability Letters

Abstract:This paper studies the f-ergodicity and its exponential convergence rate for continuous-time Markov chain. Assume f is square integrable, for reversible Markov chain, it is proved that the exponential convergence of f-ergodicity holds if and only if the spectral gap of the generator is positive. Moreover, the convergence rate is equal to the spectral gap. For irreversible case, the positivity of spectral gap remains a sufficient condition of f-ergodicity. The effectiveness of these results are illustrated by some typical examples.
Wasserstein Convergence Rate for Empirical Measures of Markov Processes

Feng-Yu Wang

2024-08-13

Abstract:The convergence rate in Wasserstein distance is estimated for empirical measures of ergodic Markov processes, and the estimate can be sharp in some specific situations. The main result is applied to subordinations of typical models excluded by existing results, which include: stochastic Hamiltonian systems on $\mathbb R^{n}\times \mathbb R^{m}$, spherical velocity Langevin processes on $\mathbb R^n\times\mathbb S^{n-1},$ multi-dimensional Wright-Fisher type diffusion processes, and stable type jump processes.

Probability
On obtaining sharp bounds of the rate of convergence for a class of continuous-time Markov chains

A.I. Zeifman,Y.A. Satin,K.M. Kiseleva

DOI: https://doi.org/10.1016/j.spl.2020.108730

2020-06-01

Abstract:<p>We study inhomogeneous continuous-time weakly ergodic Markov chains with a finite state space. We introduce the notion of a Markov chain with the regular structure of an infinitesimal matrix and study the sharp upper bounds on the rate of convergence for such class of Markov chains.</p>

statistics & probability
Coupling and Exponential Convergence Rate for Markovian Switching Jump Diffusions

Fubao Xi,Quanxin Zhu

DOI: https://doi.org/10.1080/07362994.2014.917981

2014-01-01

Stochastic Analysis and Applications

Abstract:This work is concerned with coupling and exponential convergence rate for a class of Markovian switching jump-diffusion processes. The processes under consideration can be thought of as a number of jump-diffusion processes modulated by a Markovian switching device. For this class of processes, we construct some order-preserving couplings. Furthermore, by virtue of the coupling results, we also provide an estimate of exponential convergence rate for the Markovian switching jump-diffusion processes without Gaussian noise.
Quantitative Convergence Rates for Stochastically Monotone Markov Chains

Takashi Kamihigashi,John Stachurski

2024-09-30

Abstract:For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic mixing conditions. We complement these results by providing quantitative bounds on deviations between distributions. We also show that well-known total variation bounds can be recovered as a special case.

Probability
Entropy Formula for Endomorphisms: Relations Between Entropy, Exponents and Dimension

Min Qian,Jian-Sheng Xie

DOI: https://doi.org/10.3934/dcds.2008.21.367

2008-01-01

Discrete and Continuous Dynamical Systems

Abstract:We present an entropy formula of Ledrappier-Young type for invariant measures (maybe non-SRB) of C(2) endomorphisms (maybe non-invertible and with singularities) on a compact manifold via their inverse limit spaces. This result may be considered as the most general form of entropy formula for a deterministic system with an invariant measure, and a preliminary step to Eckmann-Ruelle conjecture. As an important application, we have proved the exact dimensionality of ergodic measures invariant under expanding maps.
Exponential Convergence Rates of Second Quantization Semigroups and Applications

Changsong Deng,Feng-Yu Wang

DOI: https://doi.org/10.48550/arXiv.1012.5689

2010-12-28

Abstract:Exponential convergence rates in the $L^2$-tail norm and entropy are characterized for the second quantization semigroups by using the corresponding base Dirichlet form. This supplements the well known result on the $L^2$-exponential convergence rate of second quantization semigroups. As applications, birth-death type processes on Poisson spaces and the path space of Lévy processes are investigated.

Probability
Algebraic Convergence of Markov Chains

MF Chen,YZ Wang

DOI: https://doi.org/10.1214/aoap/1050689596

2003-01-01

Abstract:Algebraic convergence in the L-2-sense is studied for general time-continuous, reversible Markov chains with countable state space, and especially for birth-death chains. Some criteria for the convergence are presented. The results are effective since the convergence region can be completely covered, as illustrated by two examples.
Entropy and curvature: beyond the Peres-Tetali conjecture

Pietro Caputo,Florentin Münch,Justin Salez

2024-02-09

Abstract:We study Markov chains with non-negative sectional curvature on finite metric spaces. Neither reversibility, nor the restriction to a particular combinatorial distance are imposed. In this level of generality, we prove that a 1-step contraction in the Wasserstein distance implies a 1-step contraction in relative entropy, by the same amount. Our result substantially strengthens a recent breakthrough of the second author, and has the advantage of being applicable to arbitrary scales. This leads to a time-varying refinement of the standard Modified Log-Sobolev Inequality (MLSI), which allows us to leverage the well-acknowledged fact that curvature improves at large scales. We illustrate this principle with several applications, including birth and death chains, colored exclusion processes, permutation walks, Gibbs samplers for high-temperature spin systems, and attractive zero-range dynamics. In particular, we prove a MLSI with constant equal to the minimal rate increment for the mean-field zero-range process, thereby answering a long-standing question.

Probability,Combinatorics,Differential Geometry
Rates of Convergence of Extremes for Mixed Exponential Distributions

Peng Zuoxiang,Zhichao Weng,Saralees Nadarajah

DOI: https://doi.org/10.1016/j.matcom.2010.07.003

IF: 3.601

2010-01-01

Mathematics and Computers in Simulation

Abstract:The limiting distributions of the extremes of mixed exponential distributions and the associated rates of convergence are derived. The practical values of the results are illustrated by a numerical study.

Exponential Convergence Rate in Entropy

A Supplement to the Complete Convergence

THE EXPONENTIAL CONVERGENCE RATE OF THE SHANNON ENTROPY RATE OF COUNTABLE HOMOGENEOUS MARKOV CHAINS

Equivalence of exponential ergodicity and L2-exponential convergence for Markov chains

Exponential Convergence Rates for Markov Processes with Markovian Switching

Asymptotic rates of convergence for compact reversible Markov chains

Exponential Convergence in Entropy and Wasserstein for McKean–Vlasov SDEs

Rates of Convergence for Chains of Expansive Markov Operators

Exponential Convergence in Entropy and Wasserstein Distance for McKean-Vlasov SDEs

Exponential<Emphasis Type="Italic">L</Emphasis><Superscript>2</Superscript>-convergence and<Emphasis Type="Italic">L</Emphasis><Superscript>2</Superscript>-spectral gap for Markov processes

Convergence Rates of Markov Chains on Spaces of Partitions

Estimate the Exponential Convergence Rate of F-Ergodicity Via Spectral Gap

Wasserstein Convergence Rate for Empirical Measures of Markov Processes

On obtaining sharp bounds of the rate of convergence for a class of continuous-time Markov chains

Coupling and Exponential Convergence Rate for Markovian Switching Jump Diffusions

Quantitative Convergence Rates for Stochastically Monotone Markov Chains

Entropy Formula for Endomorphisms: Relations Between Entropy, Exponents and Dimension

Exponential Convergence Rates of Second Quantization Semigroups and Applications

Algebraic Convergence of Markov Chains

Entropy and curvature: beyond the Peres-Tetali conjecture

Rates of Convergence of Extremes for Mixed Exponential Distributions