Some variational formulas on additive functionals of symmetric Markov chains

daehong kim,masayoshi takeda,jiangang ying

DOI: https://doi.org/10.1090/S0002-9939-01-06308-0

IF: 0.9709

2002-01-01

Proceedings of the American Mathematical Society

Abstract:For symmetric continuous time Markov chains, we obtain some formulas on total occupation times and limit theorems of additive functionals by using large deviation theory.

What problem does this paper attempt to address?

Quasi-ergodic theorems for Feynman-Kac semigroups and large deviation for additive functionals

Daehong Kim,Takara Tagawa,Aurélien Velleret

2024-02-01

Abstract:We study the long-time behavior of an additive functional that takes into account the jumps of a symmetric Markov process. This process is assumed to be observed through a biased observation scheme that includes the survival to events of extinction and the Feynman-Kac weight by another similar additive functional. Under conditioning for the convergence to a quasi-stationary distribution and for two-sided estimates of the Feynmac-Kac semigroup to be obtained, we shall discuss general assumptions on the symmetric Markov process. For the law of additive functionals, we will prove a quasi-ergodic theorem, namely a conditional version of the ergodic theorem and a conditional functional weak law of large numbers. As an application, we also establish a large deviation principle for the mean ratio of additive functionals.

Probability
On the CLT of additive functionals of Markov chains

Magda Peligrad

DOI: https://doi.org/10.48550/arXiv.2003.00085

2020-05-18

Abstract:In this paper we study the additive functionals of Markov chains via conditioning with respect to both past and future of the chain. We shall point out new sufficient projective conditions, which assure that the variance of partial sums of n consecutive random variables of a stationary Markov chain is linear in n. The paper also addresses the central limit theorem problem and is listing several open questions.

Probability
Variational Formulas of Asymptotic Variance for General Discrete-time Markov Chains

Lu-Jing Huang,Yong-Hua Mao

DOI: https://doi.org/10.48550/arXiv.2012.13895

2020-12-27

Probability

Abstract:The asymptotic variance is an important criterion to evaluate the performance of Markov chains, especially for the central limit theorems. We give the variational formulas for the asymptotic variance of discrete-time (non-reversible) Markov chains on general state space. The variational formulas provide many applications, extending the classical Peskun's comparison theorem to non-reversible Markov chains, and obtaining several comparison theorems between Markov chains with various perturbations.
Limit Theorems for Additive Functionals of Stochastic Functional Differential Equations with Infinite Delay

Ya Wang,Fuke Wu,Chao Zhu

DOI: https://doi.org/10.1016/j.jde.2021.11.011

IF: 2.615

2021-01-01

Journal of Differential Equations

Abstract:This paper examines limit theorems for a class of stochastic functional differential equations with infinite delay. Under non-Lipschitz conditions, the strong law of large numbers and the central limit theorem for additive functionals of the segment processes are established by using limit theorems of uniform mixing Markovian processes. Under some dissipative assumptions, the law of iterated logarithm is also derived for additive functionals of such equations via a martingale difference sequence of square integrable martingales.
Large deviations and related problems for absorbing Markov chains

Jinwen Chen,Xiaoxue Deng

DOI: https://doi.org/10.1016/j.spa.2013.02.014

IF: 1.43

2013-01-01

Stochastic Processes and their Applications

Abstract:In this paper, large deviations and their connections with several other fundamental topics are investigated for absorbing Markov chains. A variational representation for the Dirichlet principal eigenvalues is given by the large deviation approach. Kingman’s decay parameters and mean ratio quasi-stationary distributions of the chains are also characterized by the large deviation rate function. As an application of these results, we interpret the “stationarity” of mean ratio quasi-stationary distributions via a concrete example. An application to quasi-ergodicity is also discussed.
Limit Theorems for Additive Functionals of Path-Dependent SDEs

Jianhai Bao,Feng-Yu Wang,Chenggui Yuan

DOI: https://doi.org/10.3934/dcds.2020224

2020-01-01

Discrete and Continuous Dynamical Systems

Abstract:By using limit theorems of uniform mixing Markov processes and martingale difference sequences, the strong law of large numbers, central limit theorem, and the law of iterated logarithm are established for additive functionals of path-dependent stochastic differential equations.
Probability and moment inequalities for additive functionals of geometrically ergodic Markov chains

Alain Durmus,Eric Moulines,Alexey Naumov,Sergey Samsonov

2023-06-15

Abstract:In this paper, we establish moment and Bernstein-type inequalities for additive functionals of geometrically ergodic Markov chains. These inequalities extend the corresponding inequalities for independent random variables. Our conditions cover Markov chains converging geometrically to the stationary distribution either in $V$-norms or in weighted Wasserstein distances. Our inequalities apply to unbounded functions and depend explicitly on constants appearing in the conditions that we consider.

Probability
Variational Inequalities and Optimization for Markov Processes Associated with Semi-Dirichlet Forms.

Tusheng Zhang

DOI: https://doi.org/10.1137/080737630

IF: 2.2

2009-01-01

SIAM Journal on Control and Optimization

Abstract:We consider an optimal stopping problem and an impulsive control for Markov processes associated with semi-Dirichlet forms. We show that the value functions are the maximum solutions of certain variational inequalities. Examples both in finite dimensions and infinite dimensions are given.
Transformation of Symmetric Multiplicative Functionals

An Hong,Ying Jiangang

DOI: https://doi.org/10.1007/s11766-996-0010-7

2002-01-01

Abstract:In the present paper the transformation of symmetric Markov processes by symmetric martingale multiplicative functionals is studied and the corresponding Dirichlet form is formulated.
Limit Theorems for quadratic forms of Markov Chains

Yves F. Atchade,Matias D. Cattaneo

DOI: https://doi.org/10.48550/arXiv.1108.2743

2011-08-13

Abstract:We develop a martingale approximation approach to studying the limiting behavior of quadratic forms of Markov chains. We use the technique to examine the asymptotic behavior of lag-window estimators in time series and we apply the results to Markov Chain Monte Carlo simulation. As another illustration, we use the method to derive a central limit theorem for U-statistics with varying kernels.

Probability
Graph-combinatorial approach for large deviations of Markov chains

Giorgio Carugno,Pierpaolo Vivo,Francesco Coghi

DOI: https://doi.org/10.1088/1751-8121/ac79e6

2022-06-03

Abstract:We consider discrete-time Markov chains and study large deviations of the pair empirical occupation measure, which is useful to compute fluctuations of pure-additive and jump-type observables. We provide an exact expression for the finite-time moment generating function, which is split in cycles and paths contributions, and scaled cumulant generating function of the pair empirical occupation measure via a graph-combinatorial approach. The expression obtained allows us to give a physical interpretation of interaction and entropic terms, and of the Lagrange multipliers, and may serve as a starting point for sub-leading asymptotics. We illustrate the use of the method for a simple two-state Markov chain.

Statistical Mechanics,Probability
Variational Perturbation Theory for Markov Processes

Hagen Kleinert,Axel Pelster,Mihai V. Putz

DOI: https://doi.org/10.1103/PhysRevE.65.066128

2002-02-22

Abstract:We develop a convergent variational perturbation theory for conditional probability densities of Markov processes. The power of the theory is illustrated by applying it to the diffusion of a particle in an anharmonic potential.

Condensed Matter
Concentration Inequalities for Sums of Markov Dependent Random Matrices

Joe Neeman,Bobby Shi,Rachel Ward

2023-10-17

Abstract:We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing previous that had only considered Hoeffding-type inequalities, and only for time-independent functions on a finite state space. In particular, we study a kind of noncommutative moment generating function, give tight bounds on it, and use a method of Garg et al. to turn this into tail bounds. Our proof proceeds spectrally, bounding the norm of a certain perturbed operator. In the process we make an interesting connection to dynamical systems and Banach space theory to prove a crucial result on the limiting behavior of our moment generating function that may be of independent interest.

Probability
Change of variable formulas for non-anticipative functionals on path space

Rama Cont,David-Antoine Fournie

DOI: https://doi.org/10.48550/arXiv.1004.1380

2010-04-09

Abstract:We derive a functional change of variable formula for {\it non-anticipative} functionals defined on the space of right continuous paths with left limits. The functional is only required to possess certain directional derivatives, which may be computed pathwise. Our results lead to functional extensions of the Ito formula for a large class of stochastic processes, including semimartingales and Dirichlet processes. In particular, we show the stability of the class of semimartingales under certain functional transformations. Keywords: change of variable formula, functional derivative, functional calculus, stochastic integral, stochastic calculus, quadratic variation, Ito formula, Dirichlet process, semimartingale, Wiener space, Föllmer integral, Ito integral, cadlag functions.

Probability,Functional Analysis
Limit Theorems of Additive Functionals for Regime-Switching Diffusions with Infinite Delay

Ya Wang,Fuke Wu,George Yin

DOI: https://doi.org/10.1016/j.spa.2023.09.002

IF: 1.43

2024-01-01

Stochastic Processes and their Applications

Abstract:This paper focuses on a class of regime-switching functional diffusion processes with infinite delay and develops a central limit theorem (CLT) for additive functionals under uniform mixing conditions. In addition, a law of iterated logarithm (LIL) for the additive functionals is also established by using the square integrable martingale difference sequences. Finally, two examples are given to illustrate our results.
Remarks on limit theorems for reversible Markov processes

Martial Longla

DOI: https://doi.org/10.48550/arXiv.1310.8239

2018-01-14

Abstract:We propose some backward-forward martingale decompositions for functions of reversible Markov chains. These decompositions are used to prove the functional CLT for reversible Markov chains with asymptotically linear variance of partial sums. We also provide a proof of the equivalence between asymptotic linearity of the variance and convergence of the integral of $1/(1-t)$ with respect to the associated spectral measure $\rho$. We also study the asymptotic behavior of linear processes having as innovations mean zero square integrable functions of stationary reversible Markov chains. We apply this study to several cases of reversible stationary Markov chains that arise in regression estimation.

Probability
Deviation inequalities for separately Lipschitz functionals of composition of random functions

Jérôme Dedecker,Paul Doukhan,Xiequan Fan

DOI: https://doi.org/10.48550/arXiv.1907.01758

2019-07-03

Abstract:We consider a class of non-homogeneous Markov chains, that contains many natural examples. Next, using martingale methods, we establish some deviation and moment inequalities for separately Lipschitz functions of such a chain, under moment conditions on some dominating random variables.

Probability,Statistics Theory
The stability and path-independence of additive functionals for multivalued mckean-vlasov sdes with non-lipschitz coefficients

Jun Gong,Huijie Qiao

2021-01-01

Abstract:Abstract. The work concerns the stability and path-independence of additive functionals for a type of multivalued McKean-Vlasov stochastic differential equations with non-Lipschitz coefficients. First, we prove the existence and uniqueness of strong solutions for multivalued McKean-Vlasov stochastic differential equation with non-Lipschitz coefficients. And then, the exponential stability of second moments for their solutions in terms of a Lyapunov function is shown. Next, we weaken the conditions and furthermore obtain the exponentially 2-ultimate boundedness of their solutions. Finally, the path-independence of additive functionals for their solutions is proved.
Large Deviations for Empirical Measures of Self-Interacting Markov Chains

Amarjit Budhiraja,Adam Waterbury,Pavlos Zoubouloglou

2023-04-11

Abstract:Let $\Delta^o$ be a finite set and, for each probability measure $m$ on $\Delta^o$, let $G(m)$ be a transition probability kernel on $\Delta^o$. Fix $x_0 \in \Delta^o$ and consider the chain $\{X_n, \; n \in \mathbb{N}_0\}$ of $\Delta^o$-valued random variables such that $X_0=x$, and given $X_0, \ldots , X_n$, the conditional distribution of $X_{n+1}$ is $G(L^{n+1})(X_n, \cdot)$, where $L^{n+1} = \frac{1}{n+1} \sum_{i=0}^{n} \delta_{X_i}$ is the empirical measure at instant $n$. Under conditions on $G$ we establish a large deviation principle for the empirical measure sequence $\{L^n, \; n \in \mathbb{N}\}$. As one application of this result we obtain large deviation asymptotics for the Aldous-Flannery-Palacios (1988) approximation scheme for quasistationary distributions of irreducible finite state Markov chains. The conditions on $G$ cover various other models of reinforced stochastic evolutions as well, including certain vertex reinforced and edge reinforced random walks and a variant of the PageRank algorithm. The particular case where $G(m)$ does not depend on $m$ corresponds to the classical results of Donsker and Varadhan (1975) on large deviations of empirical measures of Markov processes. However, unlike this classical setting, for the general self-interacting models considered here, the rate function takes a very different form; it is typically non-convex and is given through a dynamical variational formula with an infinite horizon discounted objective function.

Probability,Optimization and Control

Some variational formulas on additive functionals of symmetric Markov chains

Quasi-ergodic theorems for Feynman-Kac semigroups and large deviation for additive functionals

On the CLT of additive functionals of Markov chains

Variational Formulas of Asymptotic Variance for General Discrete-time Markov Chains

Limit Theorems for Additive Functionals of Stochastic Functional Differential Equations with Infinite Delay

Large deviations and related problems for absorbing Markov chains

Limit Theorems for Additive Functionals of Path-Dependent SDEs

Probability and moment inequalities for additive functionals of geometrically ergodic Markov chains

Variational Inequalities and Optimization for Markov Processes Associated with Semi-Dirichlet Forms.

Transformation of Symmetric Multiplicative Functionals

Limit Theorems for quadratic forms of Markov Chains

Graph-combinatorial approach for large deviations of Markov chains

Variational Perturbation Theory for Markov Processes

Concentration Inequalities for Sums of Markov Dependent Random Matrices

Change of variable formulas for non-anticipative functionals on path space

Limit Theorems of Additive Functionals for Regime-Switching Diffusions with Infinite Delay

Remarks on limit theorems for reversible Markov processes

Deviation inequalities for separately Lipschitz functionals of composition of random functions

The stability and path-independence of additive functionals for multivalued mckean-vlasov sdes with non-lipschitz coefficients

Large Deviations for Empirical Measures of Self-Interacting Markov Chains