Markov Chain Approximations to Singular Stable-like Processes

Fangjun Xu

DOI: https://doi.org/10.48550/arXiv.1210.2816

2012-10-10

Abstract:We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these chains to singular stable-like processes.

Probability

What problem does this paper attempt to address?

Markov chain approximations to singular stable-like processes

Fangjun Xu

DOI: https://doi.org/10.1016/j.spl.2012.11.032

2013-03-01

Abstract:We consider the Markov chain approximations for a class of singular stable-like processes. First, we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a sufficient condition for the weak convergence of these chains to the singular stable-like processes.

statistics & probability
STRONG APPROXIMATION OF A MARKOV CHAIN

Zhengyan LIN,Lixin ZHANG,Siu CHEUNG,Wai CHAN

DOI: https://doi.org/10.3321/j.issn:1000-8134.2005.02.011

2005-01-01

Abstract:The strong approximations of a class of non-homogenous Markov chains by Wiener processes are considered. As an application, the strong consistency, the law of the iterated logarithm and the weak convergence are established for the Markov chain adaptive designs in clinical trials.
Strong Approximation for A Class of Stationary Processes

Weidong Liu,Zhengyan Lin

DOI: https://doi.org/10.1016/j.spa.2008.01.012

IF: 1.43

2009-01-01

Stochastic Processes and their Applications

Abstract:Strong approximation for sums of a class of stationary processes with optimal bound is established. The main tools are m-dependent approximation and block techniques. Some previous results are improved.
Markov Chain Approximation of Pure Jump Processes

Ante Mimica,Nikola Sandrić,René L. Schilling

DOI: https://doi.org/10.48550/arXiv.1611.07236

2016-11-22

Abstract:In this paper we discuss weak convergence of continuous-time Markov chains to a non-symmetric pure jump process. We approach this problem using Dirichlet forms as well as semimartingales. As an application, we discuss how to approximate a given Markov process by Markov chains.

Probability
The Invariance Principle for Some Class of Markov Chains

ZY Lin

DOI: https://doi.org/10.4213/tvp615

2000-01-01

Theory of Probability and Its Applications

Abstract:This work is devoted to the invariance principle for homogeneous Markov chains with a finite state space. The proof is based on a comparison of the asymptotic behavior of sums of random variables constructed by Markov chains with the same transition matrix and various initial distributions.
Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

Li-xin Zhang

DOI: https://doi.org/10.1007/s10255-004-0173-z

2004-01-01

Abstract:The strong approximations of a class of ℝ d -valued martingales are considered. The conditions used in this paper are easier to check than those used in [3] and [9]. As an application, the strong approximation of a class of non-homogenous Markov chains is established, and the asymptotic properties are established for the multi-treatment Markov chain adaptive designs in clinical trials.
Stable limits for Markov chains via the Principle of Conditioning

Mohamed El Machkouri,Adam Jakubowski,Dalibor Volný

2018-08-14

Abstract:We study limit theorems for partial sums of instantaneous functions of a homogeneous Markov chain on a general state space. The summands are heavy-tailed and the limits are stable distributions. The conditions imposed on the transition operator $P$ of the Markov chain ensure that the limit is the same as if the summands were independent. Such a~scheme admits a physical interpretation, as given in Jara et al. (Ann. Appl. Probab., 19 (2009), 2270--2300).

Mathematics
Markov Chains Approximations of jump-Diffusion Quantum Trajectories

Clement Pellegrini

DOI: https://doi.org/10.48550/arXiv.0803.2593

2008-03-18

Abstract:"Quantum trajectories" are solutions of stochastic differential equations also called Belavkin or Stochastic Schrödinger Equations. They describe random phenomena in quantum measurement theory. Two types of such equations are usually considered, one is driven by a one-dimensional Brownian motion and the other is driven by a counting process. In this article, we present a way to obtain more advanced models which use jump-diffusion stochastic differential equations. Such models come from solutions of martingale problems for infinitesimal generators. These generators are obtained from the limit of generators of classical Markov chains which describe discrete models of quantum trajectories. Furthermore, stochastic models of jump-diffusion equations are physically justified by proving that their solutions can be obtained as the limit of the discrete trajectories.

Probability
A functional limit theorem for coin tossing Markov chains

Stefan Ankirchner,Thomas Kruse,Mikhail Urusov

2020-05-12

Abstract:We prove a functional limit theorem for Markov chains that, in each step, move up or down by a possibly state dependent constant with probability $1/2$, respectively. The theorem entails that the law of every one-dimensional regular continuous strong Markov process in natural scale can be approximated with such Markov chains arbitrarily well. The functional limit theorem applies, in particular, to Markov processes that cannot be characterized as solutions to stochastic differential equations. Our results allow to practically approximate such processes with irregular behavior; we illustrate this with Markov processes exhibiting sticky features, e.g., sticky Brownian motion and a Brownian motion slowed down on the Cantor set.

Mathematics
Approximating Markov Processes Through Filtration

Chunlai Zhou,Mingsheng Ying

DOI: https://doi.org/10.1016/j.tcs.2012.03.026

IF: 1.002

2012-01-01

Theoretical Computer Science

Abstract:In this paper, we define a probabilistic version of filtration and use it to provide a finite approximation of Markov processes. In order to measure the approximation, we employ probability logic to construct the final Markov process and define a metric on the set of Markov processes through this logic. Moreover, we show that the set endowed with this metric is a Polish space. Finally we point to some questions connecting approximation to uniformity and approximate bisimilarity as topics for future research.
Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

Martin Bladt,Oscar Peralta

2023-11-02

Abstract:The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial mathematical burden which is usually circumvented by using well-known generic distributional approximations or simulations. This article provides a novel approximation method that tailors the dynamics of a time-homogeneous Markov jump process to meet those of its time-inhomogeneous counterpart on an increasingly fine Poisson grid. Strong convergence of the processes in terms of the Skorokhod $J_1$ metric is established, and convergence rates are provided. Under traditional regularity assumptions, distributional convergence is established for unconditional proxies, to the same limit. Special attention is devoted to the case where the target process has one absorbing state and the remaining ones transient, for which the absorption times also converge. Some applications are outlined, such as univariate hazard-rate density estimation, ruin probabilities, and multivariate phase-type density evaluation.

Probability,Methodology
Strong Approximation for Moving Average Processes under Dependence Assumptions

Lin Zhengyan,Li Degui

DOI: https://doi.org/10.1016/s0252-9602(08)60023-5

2008-01-01

Abstract:Let {X-t,t >= 1} be a moving average process defined by X-t = Sigma(infinity)(k=0)a(k)xi(t-k), where {a(k), k >= 0} is a sequence of real numbers and {xi(t), -infinity < t < infinity} is a doubly infinite sequence of strictly stationary dependent random variables. Under the conditions of {a(k), k >= 0} which entail that {X-t, t >= 1} is either a long memory process or a linear process, the strong approximation of {X-t, t >= 1} to a Gaussian process is studied. Finally, the results are applied to obtain the strong approximation of a long memory process to a fractional Brownian motion and the laws of the iterated logarithm for moving average processes.
Asymptotic properties for linear processes of functionals of reversible Markov Chains

Magda Peligrad

DOI: https://doi.org/10.48550/arXiv.1205.5575

2012-05-24

Probability

Abstract:In this paper we study the asymptotic behavior of linear processes having as innovations mean zero, square integrable functions of stationary reversible Markov chains. In doing so we shall preserve the generality of coefficients assuming only that they are square summable. In this way we include in our study the long range dependence case. The only assumption imposed on the innovations is the absolute summability of their covariances. Besides the central limit theorem we also study the convergence to fractional Brownian motion. The proofs are based on general results for linear processes with stationary innovations that have interest in themselves.
On regularity of functions of Markov chains

Steven Berghout,Evgeny Verbitskiy

DOI: https://doi.org/10.48550/arXiv.2101.00608

2021-01-03

Abstract:We consider processes which are functions of finite-state Markov chains. It is well known that such processes are rarely Markov. However, such processes are often regular in the following sense: the distant past values of the process have diminishing influence on the distribution of the present value. In the present paper, we present novel sufficient conditions for regularity of functions of Markov chains.

Probability,Dynamical Systems
Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Michel Benaim,Bertrand Cloez,Fabien Panloup

DOI: https://doi.org/10.48550/arXiv.1606.06477

2017-11-13

Abstract:In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain. We then apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set and to the estimation of the spectral gap of irreducible Markov processes. Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting.

Probability
Markov chain approximations for one dimensional diffusions

Xiaodan Li,Jiangang Ying

DOI: https://doi.org/10.48550/arXiv.2004.06948

2020-04-15

Abstract:The Markov chain approximation of a one-dimensional symmetric diffusion is investigated in this paper. Given an irreducible reflecting diffusion on a closed interval with scale function $s$ and speed measure $m$, the approximating Markov chains are constructed explicitly through the trace of the Dirichlet form corresponding to the diffusion. One feature of our approach is that it does not require uniform ellipticity on diffusion coefficient of the limit object or uniform regularity on conductances of the approximative Markov chains, as imposed usually in the previous related works.

Probability
Compressibility and Stochastic Stability of Monotone Markov Chain

Sergey Foss,Michael Scheutzow

2024-03-22

Abstract:For a stochastically monotone Markov chain taking values in a Polish space, we present a number of conditions for existence and for uniqueness of its stationary regime, as well as for closeness of its transient trajectories. In particular, we generalise a basic result by Bhattacharya and Majumdar (2007) where a certain form of mixing, or swap condition was assumed uniformly over the state space. We do not rely on continuity properties of transition probabilities.

Probability
On a limit behavior of a sequence of Markov processes perturbed in a neighborhood of a singular point

Andrey Pilipenko,Yuriy Prykhodko

DOI: https://doi.org/10.48550/arXiv.1509.03529

2015-09-11

Probability

Abstract:We study a limit behavior of a sequence of Markov processes (or Markov chains) such that their distributions outside of any neighborhood of a "singular" point attract to some probability law. In any neighborhood of this point the behavior may be irregular. As an example of the general result we consider a symmetric random walk with the unit jump that is perturbed in a neighborhood of 0. The invariance principle is obtained under standard scaling of time and space. The limit process turns out to be a skew Brownian motion.
Approximation for the invariant measure with applications for jump processes (convergence in total variation distance)

Vlad Bally,Yifeng Qin

2023-06-01

Abstract:In this paper, we establish an abstract framework for the approximation of the invariant probability measure for a Markov semigroup. Following Pag{è}s and Panloup [40] we use an Euler scheme with decreasing step (unadjusted Langevin algorithm). Under some contraction property with exponential rate and some regularization properties, we give an estimate of the error in total variation distance. This abstract framework covers the main results in [40] and [14]. As a specific application we study the convergence in total variation distance to the invariant measure for jump type equations. The main technical difficulty consists in proving the regularzation properties-this is done under an ellipticity condition, using Malliavin calculus for jump processes.

Probability
Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Mads Chr Hansen,Carsten Wiuf,Chuang Xu

2023-12-11

Abstract:We study continuous-time Markov chains on the non-negative integers under mild regularity conditions (in particular, the set of jump vectors is finite and both forward and backward jumps are possible). Based on the so-called flux balance equation, we derive an iterative formula for calculating stationary measures. Specifically, a stationary measure $\pi(x)$ evaluated at $x\in\mathbb{N}_0$ is represented as a linear combination of a few generating terms, similarly to the characterization of a stationary measure of a birth-death process, where there is only one generating term, $\pi(0)$. The coefficients of the linear combination are recursively determined in terms of the transition rates of the Markov chain. For the class of Markov chains we consider, there is always at least one stationary measure (up to a scaling constant). We give various results pertaining to uniqueness and non-uniqueness of stationary measures, and show that the dimension of the linear space of signed invariant measures is equal to the number of generating terms. A minimization problem is constructed in order to compute stationary measures numerically. Moreover, a heuristic linear approximation scheme is suggested for the same purpose by first approximating the generating terms. The correctness of the linear approximation scheme is justified in some special cases. Furthermore, a decomposition of the state space into different types of states (open and closed irreducible classes, and trapping, escaping and neutral states) is presented. Applications to stochastic reaction networks are well illustrated.

Probability

Markov Chain Approximations to Singular Stable-like Processes

Markov chain approximations to singular stable-like processes

STRONG APPROXIMATION OF A MARKOV CHAIN

Strong Approximation for A Class of Stationary Processes

Markov Chain Approximation of Pure Jump Processes

The Invariance Principle for Some Class of Markov Chains

Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

Stable limits for Markov chains via the Principle of Conditioning

Markov Chains Approximations of jump-Diffusion Quantum Trajectories

A functional limit theorem for coin tossing Markov chains

Approximating Markov Processes Through Filtration

Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

Strong Approximation for Moving Average Processes under Dependence Assumptions

Asymptotic properties for linear processes of functionals of reversible Markov Chains

On regularity of functions of Markov chains

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Markov chain approximations for one dimensional diffusions

Compressibility and Stochastic Stability of Monotone Markov Chain

On a limit behavior of a sequence of Markov processes perturbed in a neighborhood of a singular point

Approximation for the invariant measure with applications for jump processes (convergence in total variation distance)

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks