STRONG APPROXIMATION OF A MARKOV CHAIN

Zhengyan LIN,Lixin ZHANG,Siu CHEUNG,Wai CHAN

DOI: https://doi.org/10.3321/j.issn:1000-8134.2005.02.011

2005-01-01

Abstract:The strong approximations of a class of non-homogenous Markov chains by Wiener processes are considered. As an application, the strong consistency, the law of the iterated logarithm and the weak convergence are established for the Markov chain adaptive designs in clinical trials.

What problem does this paper attempt to address?

Strong Approximation for A Class of Stationary Processes

Weidong Liu,Zhengyan Lin

DOI: https://doi.org/10.1016/j.spa.2008.01.012

IF: 1.43

2009-01-01

Stochastic Processes and their Applications

Abstract:Strong approximation for sums of a class of stationary processes with optimal bound is established. The main tools are m-dependent approximation and block techniques. Some previous results are improved.
Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

Li-xin Zhang

DOI: https://doi.org/10.1007/s10255-004-0173-z

2004-01-01

Abstract:The strong approximations of a class of ℝ d -valued martingales are considered. The conditions used in this paper are easier to check than those used in [3] and [9]. As an application, the strong approximation of a class of non-homogenous Markov chains is established, and the asymptotic properties are established for the multi-treatment Markov chain adaptive designs in clinical trials.
Strong Approximation for Moving Average Processes under Dependence Assumptions

Lin Zhengyan,Li Degui

DOI: https://doi.org/10.1016/s0252-9602(08)60023-5

2008-01-01

Abstract:Let {X-t,t >= 1} be a moving average process defined by X-t = Sigma(infinity)(k=0)a(k)xi(t-k), where {a(k), k >= 0} is a sequence of real numbers and {xi(t), -infinity < t < infinity} is a doubly infinite sequence of strictly stationary dependent random variables. Under the conditions of {a(k), k >= 0} which entail that {X-t, t >= 1} is either a long memory process or a linear process, the strong approximation of {X-t, t >= 1} to a Gaussian process is studied. Finally, the results are applied to obtain the strong approximation of a long memory process to a fractional Brownian motion and the laws of the iterated logarithm for moving average processes.
Strong Approximation for Ρ-Mixing Sequences

ZhengYan Lin,YueXu Zhao

DOI: https://doi.org/10.1007/s11425-012-4449-0

2012-01-01

Science China Mathematics

Abstract:We establish strong invariance principles for sums of stationary ρ-mixing random variables with finite and infinite second moments under weaker mixing rates.Some earlier results are improved.As applications,some results of the law of the iterated logarithm with finite and infinite variance are obtained,also a conjecture raised by Shao in 1993 is solved.
The Invariance Principle for Some Class of Markov Chains

ZY Lin

DOI: https://doi.org/10.4213/tvp615

2000-01-01

Theory of Probability and Its Applications

Abstract:This work is devoted to the invariance principle for homogeneous Markov chains with a finite state space. The proof is based on a comparison of the asymptotic behavior of sums of random variables constructed by Markov chains with the same transition matrix and various initial distributions.
Strong Approximation of Locally Square-Integrable Martingales

Zheng Yan Lin,Han Chao Wang

DOI: https://doi.org/10.1007/s10114-011-0196-3

2012-01-01

Abstract:In this paper, we consider the strong approximation for locally square-integrable martin-gales. In our results, the limit process may be a process with jumps. This is an extension of the former results.
Weak Convergence to Stochastic Integrals Driven by Α-Stable Lévy Processes

Zhengyan Lin,Hanchao Wang

2011-01-01

Abstract:We use the martingale convergence method to get the weak convergence theoremon general functionals of partial sums of independent heavy-tailed randomvariables. The limiting process is the stochastic integral driven byα-stable Lévy process. Our method is very powerful to obtain the limitbehavior of heavy-tailed random variables.
Markov Chain Approximations to Singular Stable-like Processes

Fangjun Xu

DOI: https://doi.org/10.48550/arXiv.1210.2816

2012-10-10

Abstract:We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these chains to singular stable-like processes.

Probability
Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

Martin Bladt,Oscar Peralta

2023-11-02

Abstract:The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial mathematical burden which is usually circumvented by using well-known generic distributional approximations or simulations. This article provides a novel approximation method that tailors the dynamics of a time-homogeneous Markov jump process to meet those of its time-inhomogeneous counterpart on an increasingly fine Poisson grid. Strong convergence of the processes in terms of the Skorokhod $J_1$ metric is established, and convergence rates are provided. Under traditional regularity assumptions, distributional convergence is established for unconditional proxies, to the same limit. Special attention is devoted to the case where the target process has one absorbing state and the remaining ones transient, for which the absorption times also converge. Some applications are outlined, such as univariate hazard-rate density estimation, ruin probabilities, and multivariate phase-type density evaluation.

Probability,Methodology
Weak convergence of adaptive Markov chain Monte Carlo

Austin Brown,Jeffrey S. Rosenthal

2024-06-03

Abstract:This article develops general conditions for weak convergence of adaptive Markov chain Monte Carlo processes and is shown to imply a weak law of large numbers for bounded Lipschitz continuous functions. This allows an estimation theory for adaptive Markov chain Monte Carlo where previously developed theory in total variation may fail or be difficult to establish. Extensions of weak convergence to general Wasserstein distances are established along with a weak law of large numbers for possibly unbounded Lipschitz functions. Applications are applied to auto-regressive processes in various settings, unadjusted Langevin processes, and adaptive Metropolis-Hastings.

Statistics Theory
Markov Chain Approximation of Pure Jump Processes

Ante Mimica,Nikola Sandrić,René L. Schilling

DOI: https://doi.org/10.48550/arXiv.1611.07236

2016-11-22

Abstract:In this paper we discuss weak convergence of continuous-time Markov chains to a non-symmetric pure jump process. We approach this problem using Dirichlet forms as well as semimartingales. As an application, we discuss how to approximate a given Markov process by Markov chains.

Probability
ASYMPTOTIC PROPERTIES OF ADAPTIVE DESIGNS VIA STRONG APPROXIMATIONS

LX Zhang

DOI: https://doi.org/10.1142/9789812702715_0007

2004-01-01

Abstract:Various adaptive designs have been proposed and applied to clinical trials, bioassay, psychophysics, etc. More and more people have been paying attention to these design methods. Via strong approximations, this paper presents asymptotic properties of several broad families of designs, such as the play-the-winner rule, randomized play-the-winner rule and its generalization to the multi-arm case, doubly biased coin adaptive design, Markov chain model. AMS 1999 subject classification. 60F15, 60F05, 62G10, 60G10.
Markov Approximation for Combinatorial Network Optimization

Minghua Chen,Soung Chang Liew,Ziyu Shao,Caihong Kai

DOI: https://doi.org/10.1109/tit.2013.2268923

IF: 2.5

2013-10-01

IEEE Transactions on Information Theory

Abstract:Many important network design problems are fundamentally combinatorial optimization problems. A large number of such problems, however, cannot readily be tackled by distributed algorithms. The Markov approximation framework studied in this paper is a general technique for synthesizing distributed algorithms. We show that when using the log–sum–exp function to approximate the optimal value of any combinatorial problem, we end up with a solution that can be interpreted as the stationary probability distribution of a class of time-reversible Markov chains. Selected Markov chains among this class yield distributed algorithms that solve the log–sum–exp approximated combinatorial network optimization problem. By examining three applications, we illustrate that the Markov approximation technique not only provides fresh perspectives to existing distributed solutions, but also provides clues leading to the construction of new distributed algorithms in various domains with provable performance. We believe the Markov approximation techniques will find applications in many other network optimization problems.

computer science, information systems,engineering, electrical & electronic
Strong Approximation Theorems for Sums of Random Variables when Extreme Terms Are Excluded

Li Xin Zhang

DOI: https://doi.org/10.1007/s101140200162

2002-01-01

Acta Mathematica Sinica English Series

Abstract:Let {X n ;n≥1} be a sequence of i.i.d. random variables and let $X^{{{\left( r \right)}}}_{n} = X_{j} $ if |X j | is the r-th maximum of |X 1|, ..., |X n |. Let S n = X 1+⋯+X n and ${}^{{{\left( r \right)}}}S_{n} = S_{n} - {\left( {X^{{{\left( 1 \right)}}}_{n} + \cdots + X^{{{\left( r \right)}}}_{n} } \right)}.$Sufficient and necessary conditions for (r) S n approximating to sums of independent normal random variables are obtained. Via approximation results, the convergence rates of the strong law of large numbers for (r) S n are studied.
Optimal approximating Markov chains for Bayesian inference

James E. Johndrow,Jonathan C. Mattingly,Sayan Mukherjee,David Dunson

DOI: https://doi.org/10.48550/arXiv.1508.03387

2017-08-29

Abstract:The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention has been paid to computational optimality in these approximating Markov Chains, or when such approximations are justified relative to obtaining shorter paths from the exact kernel. We give simple, sharp bounds for uniform approximations of uniformly mixing Markov chains. We then suggest a notion of optimality that incorporates computation time and approximation error, and use our bounds to make generalizations about properties of good approximations in the uniformly mixing setting. The relevance of these properties is demonstrated in applications to a minibatching-based approximate MCMC algorithm for large $n$ logistic regression and low-rank approximations for Gaussian processes.

Computation,Statistics Theory
A class of strong deviation theorems for the sequence of real valued random variables with respect to continuous-state non-homogeneous Markov chains

Meng-di Zhao,Zhi-yan Shi,Wei-guo Yang,Bei Wang

DOI: https://doi.org/10.1080/03610926.2020.1734838

2020-03-03

Abstract:In this paper, we consider the asymptotic behavior of the log-likelihood ratio as a measure of the deviation between a sequence of real valued random variables and a continuous-state non-homogeneous Markov chains. Then, by using the supermartingale limit theorem, we establish a class of strong deviation theorems for bivariate functions of the sequence of real valued random variables which are associated with the continuous-state non-homogeneous Markov chains.
Strong Approximations in the Almost Sure Central Limit Theorem and Limit Behavior of the Center of Mass

Zhishui Hua,Wei Wanga,Liang Dong

2024-07-04

Abstract:In this paper, we establish an almost sure central limit theorem for a general random sequence under a strong approximation condition. Additionally, we derive the law of the iterated logarithm for the center of mass corresponding to a random sequence under a different strong approximation condition. Applications to step-reinforced random walks are also discussed.

Probability
A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree

Weiguo Yang

DOI: https://doi.org/10.1080/07362994.2012.649619

2012-03-01

Stochastic Analysis and Applications

Abstract:In this article, we establish a class of strong deviation theorems for the random fields which are associated with nonhomogeneous Markov chains indexed by a Bethe tree. As corollaries, we obtain the strong law of large numbers and asymptotic equipartition property for nonhomogeneous Markov chains indexed by such tree.

mathematics, applied,statistics & probability

STRONG APPROXIMATION OF A MARKOV CHAIN

Strong Approximation for A Class of Stationary Processes

Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

Strong Approximation for Moving Average Processes under Dependence Assumptions

Strong Approximation for Ρ-Mixing Sequences

The Invariance Principle for Some Class of Markov Chains

Strong Approximation of Locally Square-Integrable Martingales

Weak Convergence to Stochastic Integrals Driven by Α-Stable Lévy Processes

Markov Chain Approximations to Singular Stable-like Processes

Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

Weak convergence of adaptive Markov chain Monte Carlo

Markov Chain Approximation of Pure Jump Processes

ASYMPTOTIC PROPERTIES OF ADAPTIVE DESIGNS VIA STRONG APPROXIMATIONS

Markov Approximation for Combinatorial Network Optimization

Strong Approximation Theorems for Sums of Random Variables when Extreme Terms Are Excluded

Optimal approximating Markov chains for Bayesian inference

A class of strong deviation theorems for the sequence of real valued random variables with respect to continuous-state non-homogeneous Markov chains

Strong Approximations in the Almost Sure Central Limit Theorem and Limit Behavior of the Center of Mass

A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree