Stochastic Monotone Markov Integrated Semigroups

Xing-yi WEN,Yang-rong LI

2009-01-01

Abstract:In this paper we discuss the relationship between monotone of Markov integrated semigroups and transition functions,which are closely linked with each other for continuous time Markov chains.By this a necessary and sufficient condition for the minimal q-semigroup to be stochastic monotone is given in terms of their q-matrix only.

What problem does this paper attempt to address?

Contraction Integrated Semigroups and Their Applicationto Continuous-time Markov Chains

Yang Rong Li

DOI: https://doi.org/10.1007/s10114-003-0277-z

2003-01-01

Acta Mathematica Sinica English Series

Abstract:We introduce the notion of the contraction integrated semigroups and give the Lumber-Phillips characterization of the generator, and also the charaterazied generators of isometric integrated semigroups. For their application, a necessary and sufficient condition for q-matrices Q generating a contraction integrated semigroup is given, and a necessary and sufficient condition for a transition function to be a Feller-Reuter-Riley transition function is also given in terms of its q-matrix.
Weak Symmetry of Markov Integrated Semigroups

Jin-jin WANG,Yang-rong LI

2009-01-01

Abstract:This paper introduces weak symmetry of Markov integrated semigroups. For a conservative single-exit q-matrix Q, sufficient and necessary conditions for a Markov integrated Q -semigroup to be honest and weakly symmetric are given.
Restriction of Markov Integrated Semigroups and Generation of Increasing Integrated Semigroups

ZHAO Wen-qiang,LI Yang-rong

2005-01-01

Acta Analysis Functionalis Applicata

Abstract:We prove that the transition function is a positive contraction C_0 semigroup on a subspace C1 of l_∞. We obtain that the generator of the Markov integrated semigroup is densely defined in l_∞ if and only if q-matrix Q is uniformly bounded. At the same time, a sufficient and necessary condition for a transition function to a Feller-Reuter-Riley transition function, is also given. Finally, in an ordered Banach space, a generation theorem is obtained for the increasing integrated semigroup of contractions.
ON THE CONVERGENCE OF TRANSITION FUNCTIONS

ZHAO Wen-qiang,LI Yang-rong

2008-01-01

Journal of Mathematics

Abstract:In this paper,we study the approximation of transition functions in continuous-time Markov chains by means of semigroups of linear operators.We discuss the convergence of Q-functions of the truncated matrices of q-matrix.The notion of Yosida approximation of an q-matrix is introduced,therefore we obtain that every Q-process can be approximated by a sequence of bounded Q-processes.Lastly,the condition on q-matrices in order that their minimal Q-functions convergence is presented.These results generalize and develop the recent works.
THE STOCHASTIC MONOTONICITY OF INHOMOGENEOUS MARKOV PROCESSES

Mei-juan ZHANG,Ming ZHANG

DOI: https://doi.org/10.3969/j.issn.0255-7797.2017.04.018

2017-01-01

Journal of Mathematics

Abstract:In this paper, we study the stochastic monotonicity of inhomogeneous Markov processes. By using and improving the proof method for the stochastic monotonicity of ho-mogeneous Markov processes, we obtain the explicit criterion for stochastic monotonicity of inhomogeneous Markov processes. Further more, this article extends this sufficient criterion to the equivalent condition.
Asymptotic stability for non-equicontinuous Markov semigroups

Fuzhou Gong,Yong Liu,Yuan Liu,Ziyu Liu

DOI: https://doi.org/10.48550/arXiv.2302.11782

2023-02-23

Probability

Abstract:We formulate a new criterion of the asymptotic stability for some non-equicontinuous Markov semigroups, the so-called eventually continuous semigroups. In particular, we provide a non-equicontinuous Markov semigroup example with essential randomness, which is asymptotically stable.
The Approximation of the Markov Integrated Semigroup

宋娜,李扬荣

2009-01-01

Abstract:By proving the approximation of the Markov integrated Q-semigroup,this paper aims to prove that the approximation of the Markov integrated semigroup on l∞ can be approximated by a family of uniformly convergent integrated semigroups.
The Markov Integrated Semigroup Generated by the Collision Branching Q-matrix

FU Li,LI Yang-rong

2009-01-01

Abstract:This paper aims to prove that the collision branching q-matrix can generate an integrated semigroup T(t) on l∞ and that if m1≤0,its generator is Q∞;if m10,its generator is Q**0.In fact,T(t) is just a Markov integrated semigroup.Also,we obtain that if m10,this integrated semigroup has the Feller property.
Column Continuous Transition Functions

Yangrong Li

DOI: https://doi.org/10.1016/j.jmaa.2006.05.001

IF: 1.417

2007-01-01

Journal of Mathematical Analysis and Applications

Abstract:A column continuous transition function is by definition a standard transition function P(t) whose every column is continuous for t⩾0 in the norm topology of bounded sequence space l∞. We will prove that it has a stable q-matrix and that there exists a one-to-one relationship between column continuous transition functions and increasing integrated semigroups on l∞. Using the theory of integrated semigroups, we give some necessary and sufficient conditions under which the minimal q-function is column continuous, in terms of its generator (of the Markov semigroup) as well as its q-matrix. Furthermore, we will construct all column continuous Q-functions for a conservative, single-exit and column bounded q-matrix Q. As applications, we find that many interesting continuous-time Markov chains (CTMCs), say Feller–Reuter–Riley processes, monotone processes, birth–death processes and branching processes, etc., have column continuity.
Monotonicity and Feller-Reuter-Riley Property of the Population Semigroups with Geometric Catastrophe

Xiu-jie LV,Yang-rong LI

DOI: https://doi.org/10.3969/j.issn.1673-9868.2007.04.012

2007-01-01

Abstract:In this paper, we show that the geometric catastrophe q-matrix Q generates a positive contraction integrated semigroup on l∞, Q also generates a continuous contraction semigroup on c0 and the minimal Q-function P(t) is always a Felle-Reuter-Riley function, and establish a criterion for stochastic monotonicity.
Integrated Semigroups Generated by Generalized Branching Processes

Xiao-xin CHANG,Yang-rong LI

2008-01-01

Abstract:This paper concentrates on investigating the condition on which q-matrix Q for generalized branching processes generates a positive once integrated semigroup of contractions on L∞, and a necessary and sufficient condi-tion is obtained. Some basic properties of the integrated semigroups generated by them, i.e. stochastic sub-monoto-ny and Feller property, are discussed.
The Hille-Yosida Theorem of w~*-Continuous Matrix Semigroup and Its Application to Markov Chains

WEN Xing-yi,LI Yang-rong,GUO Chang-chao

2008-01-01

Abstract:In this paper,we obtain the Hille-Yosida theorem of w*-continuous matrix semigroup,and then apply it to the continuous time Markov chains.
Existence and Regularity of A Nonhomogeneous Transition Matrix under Measurability Conditions

Liuer Ye,Xianping Guo,Onésimo Hernández-Lerma

DOI: https://doi.org/10.1007/s10959-008-0163-9

2008-01-01

Journal of Theoretical Probability

Abstract:This paper is about the existence and regularity of the transition probability matrix of a nonhomogeneous continuous-time Markov process with a countable state space. A standard approach to prove the existence of such a transition matrix is to begin with a continuous (in t≥0) and conservative matrix Q(t)=[q ij (t)] of nonhomogeneous transition rates q ij (t) and use it to construct the transition probability matrix. Here we obtain the same result except that the q ij (t) are only required to satisfy a mild measurability condition, and Q(t) may not be conservative. Moreover, the resulting transition matrix is shown to be the minimum transition matrix, and, in addition, a necessary and sufficient condition for it to be regular is obtained. These results are crucial in some applications of nonhomogeneous continuous-time Markov processes, such as stochastic optimal control problems and stochastic games, and this was the main motivation for this work.
Stochastic Monotonicity and Comparability of Markov Chains with Block-Monotone Transition Matrices and Their Applications to Queueing Systems

Hai-Bo Yu

DOI: https://doi.org/10.1080/15326349.2017.1349617

2017-01-01

Stochastic Models

Abstract:Motivated by various applications in queueing theory, this article is devoted to the stochastic monotonicity and comparability of Markov chains with block-monotone transition matrices. First, we introduce the notion of block-increasing convex order for probability vectors, and characterize the block-monotone matrices in the sense of the block-increasing order and block-increasing convex order. Second, we characterize the Markov chain with general transition matrix by martingale and provide a stochastic comparison of two block-monotone Markov chains under the two block-monotone orders. Third, the stochastic comparison results for the Markov chains corresponding to the discrete-time GI/G/1 queue with different service distributions under the two block-monotone orders are given, and the lower bound and upper bound of the Markov chain corresponding to the discrete-time GI/G/1 queue in the sense of the block-increasing convex order are found.
The Application of w*-Continuous Matrix Semigroup in Transition Functions

Xing-yi WEN,Yang-rong LI

2008-01-01

Abstract:In this paper,a one-to-one relationship is shown to exist between transition function and positive w*-continuous matrix contract semi-group and,using the generator theorem of the w*-continuous matrix semi-group,the condition under which the Kolmogorv forward and backward equations hold is studied.
On Three Classical Problems for Markov Chains with Continuous Time Parameters

MF CHEN

DOI: https://doi.org/10.2307/3214868

1991-01-01

Abstract:For a given transition rate, i.e., aQ-matrixQ= (qij) on a countable state space, the uniqueness of theQ-semigroupP(t) = (Pij(t)),the recurrence and the positive recurrence of the corresponding Markov chain are three fundamental and classical problems, treated in many textbooks. As an addition, this paper introduces some practical results motivated from the study of a type of interacting particle systems, reaction diffusion processes. The main results are theorems (1.11), (1.17) and (1.18). Their proofs are quite straightforward.
Compressibility and Stochastic Stability of Monotone Markov Chain

Sergey Foss,Michael Scheutzow

2024-03-22

Abstract:For a stochastically monotone Markov chain taking values in a Polish space, we present a number of conditions for existence and for uniqueness of its stationary regime, as well as for closeness of its transient trajectories. In particular, we generalise a basic result by Bhattacharya and Majumdar (2007) where a certain form of mixing, or swap condition was assumed uniformly over the state space. We do not rely on continuity properties of transition probabilities.

Probability
Quantitative Convergence Rates for Stochastically Monotone Markov Chains

Takashi Kamihigashi,John Stachurski

2024-09-30

Abstract:For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic mixing conditions. We complement these results by providing quantitative bounds on deviations between distributions. We also show that well-known total variation bounds can be recovered as a special case.

Probability
Perturbations and Approximations of Markov Integrated Semigroups

WANG Jinjin,Li Yangrong

DOI: https://doi.org/10.3724/sp.j.1160.2011.00121

2011-01-01

Acta Analysis Functionalis Applicata

Abstract:In this paper,we obtain generalized Phillips perturbation theorems and Trotter-Kato approximation theorems on Markov integrated semigroups.
An Integrated Semigroup Induced by the General Catastrophe Process

刘华,李扬荣

2008-01-01

Abstract:In this paper, we give the sufficient and necessary conditions for a general birth, death and catastrophe q-matrix Q generating a contraction integrated semigroup on l∞, and show that Q generates a minimal integrated Q-semigroup T(t) on l∞. A sufficient and necessary condition for T(t) to be monotone is also given. Finally, the Feller property of T(t) and its limit behaviour as time t tends to infinity are discussed.

Stochastic Monotone Markov Integrated Semigroups

Contraction Integrated Semigroups and Their Applicationto Continuous-time Markov Chains

Weak Symmetry of Markov Integrated Semigroups

Restriction of Markov Integrated Semigroups and Generation of Increasing Integrated Semigroups

ON THE CONVERGENCE OF TRANSITION FUNCTIONS

THE STOCHASTIC MONOTONICITY OF INHOMOGENEOUS MARKOV PROCESSES

Asymptotic stability for non-equicontinuous Markov semigroups

The Approximation of the Markov Integrated Semigroup

The Markov Integrated Semigroup Generated by the Collision Branching Q-matrix

Column Continuous Transition Functions

Monotonicity and Feller-Reuter-Riley Property of the Population Semigroups with Geometric Catastrophe

Integrated Semigroups Generated by Generalized Branching Processes

The Hille-Yosida Theorem of w~*-Continuous Matrix Semigroup and Its Application to Markov Chains

Existence and Regularity of A Nonhomogeneous Transition Matrix under Measurability Conditions

Stochastic Monotonicity and Comparability of Markov Chains with Block-Monotone Transition Matrices and Their Applications to Queueing Systems

The Application of w*-Continuous Matrix Semigroup in Transition Functions

On Three Classical Problems for Markov Chains with Continuous Time Parameters

Compressibility and Stochastic Stability of Monotone Markov Chain

Quantitative Convergence Rates for Stochastically Monotone Markov Chains

Perturbations and Approximations of Markov Integrated Semigroups

An Integrated Semigroup Induced by the General Catastrophe Process