A new result about the stochastic matrix

Shaohua Jin,Zhenyao Fan,Yan Huo,Xia Wang

2006-01-01

Abstract:The strong limit theorem for countable non-homogeneous Markov chains were discussed in no few references, where various restrictions were imposed on the Markov chains. In this paper, a new strong limit theorem on the frequency of state which hold for arbitrary countable non-homogeneous Markov chains is given.

What problem does this paper attempt to address?

Many strong limit theorems for non-homogeneous Markov chains indexed by a non-homogeneous tree

Shaohua Jin,Huitao Liu,Jian Liu,Yongxue Wang,Jian Zhang

DOI: https://doi.org/10.1109/ETCS.2010.346

2010-01-01

Abstract:The strong limit theorems is one of the central questions for studying in the International Probability theory. In this paper, many strong limit theorems for non-homogeneous Markov chains indexed by a non-homogeneous tree were obtained by constructing a non-negative martingale. © 2010 IEEE.
The Invariance Principle for Some Class of Markov Chains

ZY Lin

DOI: https://doi.org/10.4213/tvp615

2000-01-01

Theory of Probability and Its Applications

Abstract:This work is devoted to the invariance principle for homogeneous Markov chains with a finite state space. The proof is based on a comparison of the asymptotic behavior of sums of random variables constructed by Markov chains with the same transition matrix and various initial distributions.
STRONG APPROXIMATION OF A MARKOV CHAIN

Zhengyan LIN,Lixin ZHANG,Siu CHEUNG,Wai CHAN

DOI: https://doi.org/10.3321/j.issn:1000-8134.2005.02.011

2005-01-01

Abstract:The strong approximations of a class of non-homogenous Markov chains by Wiener processes are considered. As an application, the strong consistency, the law of the iterated logarithm and the weak convergence are established for the Markov chain adaptive designs in clinical trials.
A Poisson limit theorem for a strongly ergodic non-homogeneous Markov chain

Han-xing Wang,Mao-ning Tang,Jian-chao Fang,Rong-ming Wang

DOI: https://doi.org/10.1016/S0022-247X(02)00367-0

IF: 1.417

2003-01-01

Journal of Mathematical Analysis and Applications

Abstract:A strongly ergodic non-homogeneous Markov chain is considered in the paper. As an analog of the Poisson limit theorem for a homogeneous Markov chain recurring to small cylindrical sets, a Poisson limit theorem is given for the non-homogeneous Markov chain. Meanwhile, some interesting results about approximation independence and probabilities of small cylindrical sets are given.
A Class of Strong Limit Theorems of Markov Chains in Random Environments

XU Hua,WANG Ming-gang

DOI: https://doi.org/10.3969/j.issn.1674-3229-B.2010.01.006

2010-01-01

Abstract:The constructive definition of Markov Chains in Random Environments is given.A strong limit theorem for arbitrary stochastic sequence has been extended to the random environment by martingale theorem.As a result,a class of strong limit theorems of Markov Chains in random environments is obtained.
Limit Theorems For Stochastic Vector-Valued Sequences And Their Applications

Zhenhua Bao,Zhongxing Ye,Weiguo Yang

2008-01-01

Southeast Asian Bulletin of Mathematics

Abstract:In this paper, the strong limit theorems for stochastic vector-valued sequences are studied. The strong laws of large numbers for *-mixing vector -valued sequences are proved. As applications, we obtain some limit theorems for portfolios under the model of long term behavior of a sequence investment.
Some Strong Limit Theorems for two Orders Markov Chains on a Special Kind of Non-Homogeneous Tree

JIN Shao-hua,HUO Yan,CUI Chun-hong,HUO Long-long

DOI: https://doi.org/10.3969/j.issn.1000-0984.2013.02.029

2013-01-01

Abstract:The limit theorems is one of the central questions for studying in the international Probability theory.In this paper,some strong limit theorems for two orders Markov chains on a special kind of non-homogeneous tree were obtained by constructing a non-negative martingale.
Class of Strong Limit Theorems of Non-homogeneous Markov Chains in Random Environments

许华,王明刚

DOI: https://doi.org/10.3969/j.issn.1671-1815.2010.05.021

2010-01-01

Abstract:The constructive definition of Markov chains in random environments is given.A class of strong limit theorems of Markov chains in random environments by martingale theorem is proved.
Strong Limit Theorems for (Α,β)-Mixing Random Variable Sequences

SHEN Yan,ZHANG Yongjun,WANG Xuejun,HU Shuhe

DOI: https://doi.org/10.3969/j.issn.0253-2778.2011.09.005

2011-01-01

JUSTC

Abstract:Some convergence theorems for (α,β)-mixing random variables were studied and some results on strong stability for weighted sums of (α,β)-mixing random variables were presented.Some new strong laws for large numbers were also obtained.These results generalize the corresponding results of independent random variable sequences.
A functional limit theorem for coin tossing Markov chains

Stefan Ankirchner,Thomas Kruse,Mikhail Urusov

2020-05-12

Abstract:We prove a functional limit theorem for Markov chains that, in each step, move up or down by a possibly state dependent constant with probability $1/2$, respectively. The theorem entails that the law of every one-dimensional regular continuous strong Markov process in natural scale can be approximated with such Markov chains arbitrarily well. The functional limit theorem applies, in particular, to Markov processes that cannot be characterized as solutions to stochastic differential equations. Our results allow to practically approximate such processes with irregular behavior; we illustrate this with Markov processes exhibiting sticky features, e.g., sticky Brownian motion and a Brownian motion slowed down on the Cantor set.

Mathematics
Some limit theorems for the second-order Markov chains indexed by a general infinite tree with uniform bounded degree

Zhiyan Shi,Weiguo Yang,Lixin Tian,Qingpei Zang

DOI: https://doi.org/10.1186/1029-242X-2012-2

2012-01-01

Journal of Inequalities and Applications

Abstract:In this paper, we study a convergence theorem for a finite second-order Markov chain indexed by a general infinite tree with uniformly bounded degree. Meanwhile, the strong law of large numbers (LLN) and Shannon-McMillan theorem for a finite second-order Markov chain indexed by this tree are obtained. 2000 Mathematics Subject Classification: 60F15; 60J10.
Weak And Strong Limit Theorems For Stochastic Processes Under Nonadditive Probability

Xiaoyan Chen,Zengjing Chen

DOI: https://doi.org/10.1155/2014/645947

2014-01-01

Abstract and Applied Analysis

Abstract:This paper extends laws of large numbers under upper probability to sequences of stochastic processes generated by linear interpolation. This extension characterizes the relation between sequences of stochastic processes and subsets of continuous function space in the framework of upper probability. Limit results for sequences of functional random variables and some useful inequalities are also obtained as applications.
Stable limits for Markov chains via the Principle of Conditioning

Mohamed El Machkouri,Adam Jakubowski,Dalibor Volný

2018-08-14

Abstract:We study limit theorems for partial sums of instantaneous functions of a homogeneous Markov chain on a general state space. The summands are heavy-tailed and the limits are stable distributions. The conditions imposed on the transition operator $P$ of the Markov chain ensure that the limit is the same as if the summands were independent. Such a~scheme admits a physical interpretation, as given in Jara et al. (Ann. Appl. Probab., 19 (2009), 2270--2300).

Mathematics
A Strong Limit Theorem for Functions of Continuous Random Variables and an Extension of the Shannon-McMillan Theorem

Gaorong Li,Shuang Chen,Sanying Feng

DOI: https://doi.org/10.1155/2008/639145

2008-01-01

Journal of Applied Mathematics

Abstract:By means of the notion of likelihood ratio, the limit properties of the sequences of arbitrary-dependent continuous random variables are studied, and a kind of strong limit theorems represented by inequalities with random bounds for functions of continuous random variables is established. The Shannon-McMillan theorem is extended to the case of arbitrary continuous information sources. In the proof, an analytic technique, the tools of Laplace transform, and moment generating functions to study the strong limit theorems are applied. Copyright (c) 2008 Gaorong Li et al.
A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree

Weiguo Yang

DOI: https://doi.org/10.1080/07362994.2012.649619

2012-03-01

Stochastic Analysis and Applications

Abstract:In this article, we establish a class of strong deviation theorems for the random fields which are associated with nonhomogeneous Markov chains indexed by a Bethe tree. As corollaries, we obtain the strong law of large numbers and asymptotic equipartition property for nonhomogeneous Markov chains indexed by such tree.

mathematics, applied,statistics & probability
Strong Law of Large Numbers and Asymptotic Equipartition Property for Nonsymmetric Markov Chain Fields on Cayley Trees

Zhenhua Bao,Zhongxing Ye

DOI: https://doi.org/10.1016/s0252-9602(07)60080-0

2007-01-01

Abstract:Some strong laws of large numbers for the frequencies of occurrence of states and ordered couples of states for nonsymmetric Markov chain fields (NSMC) on Cayley trees are studied. In the proof, a new technique for the study of strong limit theorems of Markov chains is extended to the case of Markov chain fields. The asymptotic equipartition properties with almost everywhere (a.e.) convergence for NSMC on Cayley trees are obtained.
LIMIT PROPERTY OF FINITE STOCHASTIC SYSTEM

Fang Wang,Yongbin Qin,Daoyun Xu

DOI: https://doi.org/10.3969/j.issn.1000-386x.2014.03.062

2014-01-01

Abstract:The compression on system state set in the process of the state transition in finite stochastic system divides the system into two kinds of stochastic subsystem,and the quotient system of such system is built based on this.In the quotient system,according to the characteristics of probability matrix of incomplete subsystem,the definition of weak probability matrix is introduced,and combined with the limit properties of weak probability matrix,the limit properties of probability matrix which corresponds to quotient system are investigated.On the premise of retaining the limit properties of the original stochastic system,the computational complexity has been significantly reduced.
A Strong Limit Theorem for the Average of Ternary Functions of Markov Chains in Bi-Infinite Random Environments

Wei Liu,Chaoqun Ma,Yingqiu Li,Suming Wang

DOI: https://doi.org/10.1016/j.spl.2015.01.029

IF: 0.718

2015-01-01

Statistics & Probability Letters

Abstract:We consider strong limit theorems for Markov chains in bi-infinite random environments. We first give a new proof of a strong limit theorem of Liu and Yang (1995) on the average of functions of non-homogeneous Markov chains by constructing a nonnegative martingale. As corollaries, for a Markov chain in a bi-infinite random environment, we obtain strong limit theorems for the conditional relative entropy and for the number of times that the Markov chain and related processes reach a given point.
The Asymptotic Equipartition Property for Nonhomogeneous Markov Chains Indexed by a Homogeneous Tree

Weiguo Yang,Zhongxing Ye

DOI: https://doi.org/10.1109/TIT.2007.903134

IF: 2.5

2007-01-01

IEEE Transactions on Information Theory

Abstract:In this correspondence, we first establish a strong limit theorem for countable nonhomogeneous Markov chains indexed by a homogeneous tree. As corollaries, we obtain some strong limit theorems for frequencies of occurrence of states and ordered couple of states for these Markov chains. Finally, we prove the strong law of large numbers and the asymptotic equipartition property (AEP) for finite nonhomogeneous Markov chains indexed by a homogeneous tree.
A Perron-Frobenius Theorem for Strongly Aperiodic Stochastic Chains

Rohit Parasnis,Massimo Franceschetti,Behrouz Touri

2024-12-05

Abstract:We derive a generalization of the Perron-Frobenius theorem to time-varying row-stochastic matrices as follows: using Kolmogorov's concept of absolute probability sequences, which are time-varying analogs of principal eigenvectors, we identify a set of connectivity conditions that generalize the notion of irreducibility (strong connectivity) to time-varying matrices (networks), and we show that under these conditions, the absolute probability sequence associated with a given matrix sequence is (a) uniformly positive and (b) unique. Our results apply to both discrete-time and continuous-time settings. We then discuss a few applications of our main results to non-Bayesian learning, distributed optimization, opinion dynamics, and averaging dynamics over random networks.

Optimization and Control

A new result about the stochastic matrix

Many strong limit theorems for non-homogeneous Markov chains indexed by a non-homogeneous tree

The Invariance Principle for Some Class of Markov Chains

STRONG APPROXIMATION OF A MARKOV CHAIN

A Poisson limit theorem for a strongly ergodic non-homogeneous Markov chain

A Class of Strong Limit Theorems of Markov Chains in Random Environments

Limit Theorems For Stochastic Vector-Valued Sequences And Their Applications

Some Strong Limit Theorems for two Orders Markov Chains on a Special Kind of Non-Homogeneous Tree

Class of Strong Limit Theorems of Non-homogeneous Markov Chains in Random Environments

Strong Limit Theorems for (Α,β)-Mixing Random Variable Sequences

A functional limit theorem for coin tossing Markov chains

Some limit theorems for the second-order Markov chains indexed by a general infinite tree with uniform bounded degree

Weak And Strong Limit Theorems For Stochastic Processes Under Nonadditive Probability

Stable limits for Markov chains via the Principle of Conditioning

A Strong Limit Theorem for Functions of Continuous Random Variables and an Extension of the Shannon-McMillan Theorem

A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree

Strong Law of Large Numbers and Asymptotic Equipartition Property for Nonsymmetric Markov Chain Fields on Cayley Trees

LIMIT PROPERTY OF FINITE STOCHASTIC SYSTEM

A Strong Limit Theorem for the Average of Ternary Functions of Markov Chains in Bi-Infinite Random Environments

The Asymptotic Equipartition Property for Nonhomogeneous Markov Chains Indexed by a Homogeneous Tree

A Perron-Frobenius Theorem for Strongly Aperiodic Stochastic Chains