Carr-Nadtochiy's Weak Reflection Principle for Markov Chains on $\mathbf{Z}^d$

Yuri Imamura

DOI: https://doi.org/10.48550/arXiv.1810.00418

2018-10-01

Abstract:The present paper establishes a discrete version of the result obtained by P. Carr and S. Nadtochiy (2011) for 1-dimensional diffusion processes. Our result is for Markov chains on $\mathbf{Z}^d$.

Probability

What problem does this paper attempt to address?

The Invariance Principle for Some Class of Markov Chains

ZY Lin

DOI: https://doi.org/10.4213/tvp615

2000-01-01

Theory of Probability and Its Applications

Abstract:This work is devoted to the invariance principle for homogeneous Markov chains with a finite state space. The proof is based on a comparison of the asymptotic behavior of sums of random variables constructed by Markov chains with the same transition matrix and various initial distributions.
Weak reflection principle for Lévy processes

Erhan Bayraktar,Sergey Nadtochiy

DOI: https://doi.org/10.1214/14-AAP1073

2015-10-26

Abstract:In this paper, we develop a new mathematical technique which allows us to express the joint distribution of a Markov process and its running maximum (or minimum) through the marginal distribution of the process itself. This technique is an extension of the classical reflection principle for Brownian motion, and it is obtained by weakening the assumptions of symmetry required for the classical reflection principle to work. We call this method a weak reflection principle and show that it provides solutions to many problems for which the classical reflection principle is typically used. In addition, unlike the classical reflection principle, the new method works for a much larger class of stochastic processes which, in particular, do not possess any strong symmetries. Here, we review the existing results which establish the weak reflection principle for a large class of time-homogeneous diffusions on a real line and then proceed to extend this method to the Lévy processes with one-sided jumps (subject to some admissibility conditions). Finally, we demonstrate the applications of the weak reflection principle in financial mathematics, computational methods and inverse problems.

Probability,Pricing of Securities
Markov chain approximations for one dimensional diffusions

Xiaodan Li,Jiangang Ying

DOI: https://doi.org/10.48550/arXiv.2004.06948

2020-04-15

Abstract:The Markov chain approximation of a one-dimensional symmetric diffusion is investigated in this paper. Given an irreducible reflecting diffusion on a closed interval with scale function $s$ and speed measure $m$, the approximating Markov chains are constructed explicitly through the trace of the Dirichlet form corresponding to the diffusion. One feature of our approach is that it does not require uniform ellipticity on diffusion coefficient of the limit object or uniform regularity on conductances of the approximative Markov chains, as imposed usually in the previous related works.

Probability
Bernstein-type Inequalities for Markov Chains and Markov Processes: A Simple and Robust Proof

De Huang,Xiangyuan Li

2024-08-15

Abstract:We establish a new Bernstein-type deviation inequality for general discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to satisfy an iterated Poincaré inequality. Moreover, our method can be readily generalized to continuous-time Markov processes.

Probability
Remarks on limit theorems for reversible Markov processes

Martial Longla

DOI: https://doi.org/10.48550/arXiv.1310.8239

2018-01-14

Abstract:We propose some backward-forward martingale decompositions for functions of reversible Markov chains. These decompositions are used to prove the functional CLT for reversible Markov chains with asymptotically linear variance of partial sums. We also provide a proof of the equivalence between asymptotic linearity of the variance and convergence of the integral of $1/(1-t)$ with respect to the associated spectral measure $\rho$. We also study the asymptotic behavior of linear processes having as innovations mean zero square integrable functions of stationary reversible Markov chains. We apply this study to several cases of reversible stationary Markov chains that arise in regression estimation.

Probability
Some Probabilistic Properties of General Topological Markov Chains

Eduardo A. Silva,Elis G. Mesquita,Edgar Matias

2023-10-20

Abstract:In this paper, we utilize the framework of Markov processes to attain a more probabilistic perspective on the theory of transfer operators. In doing so, we establish a functional central limit theorem (FLCT) for an $O(N)$ model associated with Dyson potential on the one-dimensional lattice. We also proof a FLCT on a non-compact alphabet setting, for a model associated with a Dyson type potential on the one-dimensional lattice. A Breimann ergodic theorem for equilibrium measures arising from the Ruelle Operator Formalism is proved. Furthermore, we obtain a qualitative criterion (strong transitivity) to determine when the conformal measure has full support. As an application, we show how to connect the Ruelle operator framework with the perspective of the Hopf theory of Markov Processes.

Dynamical Systems
Quantitative contraction rates for Markov chains on general state spaces

Andreas Eberle,Mateusz B. Majka

DOI: https://doi.org/10.48550/arXiv.1808.07033

2018-08-22

Abstract:We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently been derived by combining appropriate couplings with carefully designed Kantorovich distances. In this paper, we partially carry over this approach from diffusions to Markov chains. We derive quantitative lower bounds on contraction rates for Markov chains on general state spaces that are powerful if the dynamics is dominated by small local moves. For Markov chains on $\mathbb{R^d}$ with isotropic transition kernels, the general bounds can be used efficiently together with a coupling that combines maximal and reflection coupling. The results are applied to Euler discretizations of stochastic differential equations with non-globally contractive drifts, and to the Metropolis adjusted Langevin algorithm for sampling from a class of probability measures on high dimensional state spaces that are not globally log-concave.

Probability
Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

MP QIAN,M QIAN,C QIAN

1984-01-01

Abstract:In this paper, the relation between the irreversibility and circulation of a Markov chainwith continuous time parameter is considered. By the calculation of determinants, it showshow the probability approach in[1] is related to T. Hill's results.
A Dirichlet process characterization of a class of reflected diffusions

Weining Kang,Kavita Ramanan

DOI: https://doi.org/10.1214/09-AOP487

2010-10-11

Abstract:For a class of stochastic differential equations with reflection for which a certain ${\mathbb{L}}^p$ continuity condition holds with $p>1$, it is shown that any weak solution that is a strong Markov process can be decomposed into the sum of a local martingale and a continuous, adapted process of zero $p$-variation. When $p=2$, this implies that the reflected diffusion is a Dirichlet process. Two examples are provided to motivate such a characterization. The first example is a class of multidimensional reflected diffusions in polyhedral conical domains that arise as approximations of certain stochastic networks, and the second example is a family of two-dimensional reflected diffusions in curved domains. In both cases, the reflected diffusions are shown to be Dirichlet processes, but not semimartingales.

Probability
On a boundary of the central limit theorem for strictly stationary, reversible Markov chains

Richard C. Bradley

2024-11-06

Abstract:Consider the class of (functions of) strictly stationary Markov chains in which (i) the second moments are finite and (ii) absolute regularity (beta-mixing) is satisfied with exponential mixing rate. For (functions of) Markov chains in that class that are also reversible, the central limit theorem holds, as a well known byproduct of results of Roberts, Rosenthal, and Tweedie in two papers in 1997 and 2001 involving reversible Markov chains. In contrast, for (functions of) Markov chains in that class that are not reversible, the central limit theorem may fail to hold, as is known from counterexamples, including ones with arbitrarily fast mixing rate (for absolute regularity). Here it will be shown that for Markov chains in that class that are reversible, the``borderline'' class of mixing rates (for absolute regularity) for the central limit theorem is in fact exponential. That will be shown here with a class of counterexamples: strictly stationary, countable-state Markov chains that are reversible, have finite second moments, and satisfy absolute regularity with mixing rates that can be arbitrarily close to (but not quite) exponential, but fail to satisfy the central limit theorem.

Probability
Walsh's Brownian Motion and Donsker Scaling Limits of Perturbed Random Walks

Ilya Pavlyukevich,Andrey Pilipenko

2024-08-19

Abstract:In this paper we study Markov chains with the state space given by the coordinate axes of $\mathbb R^m$, $m \geq 2$, whose step sizes on each positive half-axis are distributed according to a centered probability distribution with variance $v_i^2 \in (0, \infty)$, $i = 1,\ldots, m$. Under very mild assumptions on the jumps sizes on the negative half-axes, we show that the Donsker scaling limit of such Markov chains is a Walsh Brownian motion whose weights are determined explicitly in terms of stationary distributions of certain embedded Markov chains. This convergence result is applied to integer-valued random walks perturbed on a finite subset of $\mathbb Z$ called a membrane. We show that their Donsker scaling limit is an oscillating skew Brownian motion.

Probability
A functional limit theorem for coin tossing Markov chains

Stefan Ankirchner,Thomas Kruse,Mikhail Urusov

2020-05-12

Abstract:We prove a functional limit theorem for Markov chains that, in each step, move up or down by a possibly state dependent constant with probability $1/2$, respectively. The theorem entails that the law of every one-dimensional regular continuous strong Markov process in natural scale can be approximated with such Markov chains arbitrarily well. The functional limit theorem applies, in particular, to Markov processes that cannot be characterized as solutions to stochastic differential equations. Our results allow to practically approximate such processes with irregular behavior; we illustrate this with Markov processes exhibiting sticky features, e.g., sticky Brownian motion and a Brownian motion slowed down on the Cantor set.

Mathematics
A reverse ergodic theorem for inhomogeneous killed Markov chains and application to a new uniqueness result for reflecting diffusions

Cristina Costantini,Thomas G. Kurtz

2023-08-23

Abstract:Bass and Pardoux (1987) deduce from the Krein-Rutman theorem a reverse ergodic theorem for a sub-probability transition function, which turns out to be a key tool in proving uniqueness of reflecting Brownian Motion in cones in Kwon and Williams (1991) and Taylor and Williams (1993). By a different approach, we are able to prove an analogous reverse ergodic theorem for a family of inhomogeneous sub-probability transition functions. This allows us to prove existence and uniqueness for a diffusion process with varying, oblique direction of reflection, in a domain with one singular point that can be approximated, near the singular point, by a smooth cone, under natural, easily verifiable geometric conditions.

Probability
Rosenthal-type inequalities for linear statistics of Markov chains

Alain Durmus,Eric Moulines,Alexey Naumov,Sergey Samsonov,Marina Sheshukova

2023-06-28

Abstract:In this paper, we establish novel deviation bounds for additive functionals of geometrically ergodic Markov chains similar to Rosenthal and Bernstein inequalities for sums of independent random variables. We pay special attention to the dependence of our bounds on the mixing time of the corresponding chain. More precisely, we establish explicit bounds that are linked to the constants from the martingale version of the Rosenthal inequality, as well as the constants that characterize the mixing properties of the underlying Markov kernel. Finally, our proof technique is, up to our knowledge, new and based on a recurrent application of the Poisson decomposition.

Probability,Statistics Theory,Machine Learning
Weak convergence of Markovian random evolution in a multidimensional space

Igor V. Samoilenko

DOI: https://doi.org/10.48550/arXiv.1112.6242

2011-12-29

Abstract:We study Markovian symmetry and non-symmetry random evolutions in $\mathbf{R}^n$. Weak convergence of Markovian symmetry random evolution to Wiener process and of Markovian non-symmetry random evolution to a diffusion process with drift is proved using problems of singular perturbation for the generators of evolutions. Relative compactness in $\mathbf{D}_{\mathbf{R}^n\times\Theta}[0,\infty)$ of the families of Markovian random evolutions is also shown.

Probability
Markov Chains Approximations of jump-Diffusion Quantum Trajectories

Clement Pellegrini

DOI: https://doi.org/10.48550/arXiv.0803.2593

2008-03-18

Abstract:"Quantum trajectories" are solutions of stochastic differential equations also called Belavkin or Stochastic Schrödinger Equations. They describe random phenomena in quantum measurement theory. Two types of such equations are usually considered, one is driven by a one-dimensional Brownian motion and the other is driven by a counting process. In this article, we present a way to obtain more advanced models which use jump-diffusion stochastic differential equations. Such models come from solutions of martingale problems for infinitesimal generators. These generators are obtained from the limit of generators of classical Markov chains which describe discrete models of quantum trajectories. Furthermore, stochastic models of jump-diffusion equations are physically justified by proving that their solutions can be obtained as the limit of the discrete trajectories.

Probability
Limit Theorems for quadratic forms of Markov Chains

Yves F. Atchade,Matias D. Cattaneo

DOI: https://doi.org/10.48550/arXiv.1108.2743

2011-08-13

Abstract:We develop a martingale approximation approach to studying the limiting behavior of quadratic forms of Markov chains. We use the technique to examine the asymptotic behavior of lag-window estimators in time series and we apply the results to Markov Chain Monte Carlo simulation. As another illustration, we use the method to derive a central limit theorem for U-statistics with varying kernels.

Probability
Existence of strong solutions for one-dimensional reflected mixed stochastic delay differential equations

Monir Chadad,Mohamed Erraoui

DOI: https://doi.org/10.1515/forum-2023-0288

2024-03-27

Forum Mathematicum

Abstract:Relying on the pathwise uniqueness property, we prove existence of the strong solution of a one-dimensional reflected stochastic delay equation driven by a mixture of independent Brownian and fractional Brownian motions. The difficulty is that on the one hand we cannot use the fixed-point and contraction mapping methods because of the stochastic and pathwise integrals, and on the other hand the non-continuity of the Skorokhod map with respect to the norms considered.

mathematics, applied
The Generalized Entropy Ergodic Theorem for Nonhomogeneous Markov Chains

Zhongzhi Wang,Weiguo Yang

DOI: https://doi.org/10.48550/arXiv.1501.03899

2015-01-16

Abstract:Let $(\xi_n)_{n=0}^\infty$ be a nonhomogeneous Markov chain taking values from finite state-space of $\mathbf{X}=\{1,2,\ldots,b\}$. In this paper, we will study the generalized entropy ergodic theorem with almost-everywhere and $\mathcal{L}_1$ convergence for nonhomogeneous Markov chains, which generalizes the corresponding classical results for the Markov chains.

Probability
A discrete-time Matsumoto-Yor theorem

Charlie Herent

2024-09-02

Abstract:We study a random walk on the subgroup of lower triangular matrices of SL$_2$, with i.i.d. increments. We prove that the process of the lower corner of the random walk satisfies a Rogers-Pitman criterion to be a Markov chain if and only if the increments are distributed according to a Generalized Inverse Gaussian (GIG) law on their diagonals. For this, we prove a new characterization of these laws. We prove a discrete-time version of the Dufresne identity. We show how to recover the Matsumoto-Yor theorem by taking the continuous limit of the random walk.

Probability

Carr-Nadtochiy's Weak Reflection Principle for Markov Chains on $\mathbf{Z}^d$

The Invariance Principle for Some Class of Markov Chains

Weak reflection principle for Lévy processes

Markov chain approximations for one dimensional diffusions

Bernstein-type Inequalities for Markov Chains and Markov Processes: A Simple and Robust Proof

Remarks on limit theorems for reversible Markov processes

Some Probabilistic Properties of General Topological Markov Chains

Quantitative contraction rates for Markov chains on general state spaces

Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

A Dirichlet process characterization of a class of reflected diffusions

On a boundary of the central limit theorem for strictly stationary, reversible Markov chains

Walsh's Brownian Motion and Donsker Scaling Limits of Perturbed Random Walks

A functional limit theorem for coin tossing Markov chains

A reverse ergodic theorem for inhomogeneous killed Markov chains and application to a new uniqueness result for reflecting diffusions

Rosenthal-type inequalities for linear statistics of Markov chains

Weak convergence of Markovian random evolution in a multidimensional space

Markov Chains Approximations of jump-Diffusion Quantum Trajectories

Limit Theorems for quadratic forms of Markov Chains

Existence of strong solutions for one-dimensional reflected mixed stochastic delay differential equations

The Generalized Entropy Ergodic Theorem for Nonhomogeneous Markov Chains

A discrete-time Matsumoto-Yor theorem