Α–transience and Α–recurrence of Right Processes

Min Zhi Zhao,Jian Gang Ying

DOI: https://doi.org/10.1007/s10114-005-0667-5

2006-01-01

Abstract:In this article, we mainly discuss some potential theory in the framework of right Markov processes. We introduce the concept of α–excessive function, α–recurrence and α–transience for right processes with α ≤ 0, and give a thorough investigation.

What problem does this paper attempt to address?

Α-Transience AND Α-Recurrence FOR RANDOM WALKS AND LÉVY PROCESSES

HZ Zhang,MZ Zhao,JG Ying

DOI: https://doi.org/10.1142/s0252959905000129

2005-01-01

Abstract:The authors investigate the a-transience and a-recurrence for random walks and Levy processes by means of the associated moment generating function, give a dichotomy theorem for not one-sided processes and prove that the process X is quasisymmetric if and only if X is not a-recurrent for all alpha < 0 which gives a probabilistic explanation of quasi-symmetry, a concept originated from C. J. Stone.
n-type Markov Branching Processes with Immigration

Junping Li,Juan Wang,Yanchao Zang

DOI: https://doi.org/10.48550/arXiv.1512.04696

2015-12-15

Abstract:In this paper, we consider $n$-type Markov branching processes with immigration and resurrection. The uniqueness criteria are first established. Then, a new method is found and the explicit expression of extinction probability is successfully obtained in the absorption case, the mean extinction time is also given. The recurrence and ergodicity criteria are given if the state ${\bf 0}$ is not absorptive. Finally, if the resurrection rates are same as the immigration rates, the branching property and decay property are discussed in detail, it is shown that the process is a superimposition of a $n$-type branching process and an immigration. The exact value of the decay parameter $\lambda_Z$ is given for the irreducible class ${\bf Z}_+^n$. Moreover, the corresponding $\lambda_Z$-invariant measures/vectors and quasi-distributions are presented.

Probability
Renewal and Regenerative Processes: short review

Carlos Martinez-Rodriguez

2024-08-02

Abstract:This document presents a compilation of results related to the theory of stochastic processes, with a specific focus on Markov processes, regenerative processes, renewal processes, and stationary processes. The relevance of these topics lies in the ability to identify regeneration points and the necessary conditions to ensure the stationarity of the process. The study begins with a review of Markov chains and continues with the analysis of processes that satisfy the strong Markov property. Subsequently, it delves into renewal processes, regenerative processes, and finally, stationary regenerative processes, highlighting the results presented by Thorisson [22]. This work is not intended to be exhaustive but aims to provide a solid foundation for further deepening the knowledge of these processes, given their broad range of applications in cryptography [16], queueing theory [15], and Monte Carlo methods [23]. Additionally, the importance of Poisson-type processes is emphasized due to their numerous applications (see [8]).

Probability
Transience and Recurrence of Markov Processes with Constrained Local Time

Adam Barker

DOI: https://doi.org/10.48550/arXiv.1806.05965

2020-12-23

Abstract:We study Markov processes conditioned so that their local time must grow slower than a prescribed function. Building upon recent work on Brownian motion with constrained local time in [5] and [33], we study transience and recurrence for a broad class of Markov processes. In order to understand the distribution of the local time, we determine the distribution of a non-decreasing Lévy process (the inverse local time) conditioned to remain above a given level which varies in time. We study a time-dependent region, in contrast to previous works in which a process is conditioned to remain in a fixed region (e.g. [21,27]), so we must study boundary crossing probabilities for a family of curves, and thus obtain uniform asymptotics for such a family. Main results include necessary and sufficient conditions for transience or recurrence of the conditioned Markov process. We will explicitly determine the distribution of the inverse local time for the conditioned process, and in the transient case, we explicitly determine the law of the conditioned Markov process. In the recurrent case, we characterise the "entropic repulsion envelope" via necessary and sufficient conditions.

Probability
Recurrence for branching Markov chains

Sebastian Müller

DOI: https://doi.org/10.48550/arXiv.0710.4651

2008-11-12

Abstract:The question of recurrence and transience of branching Markov chains is more subtle than for ordinary Markov chains; they can be classified in transience, weak recurrence, and strong recurrence. We review criteria for transience and weak recurrence and give several new conditions for weak recurrence and strong recurrence. These conditions make a unified treatment of known and new examples possible and provide enough information to distinguish between weak and strong recurrence. This represents a step towards a general classification of branching Markov chains. In particular, we show that in \emph{homogeneous} cases weak recurrence and strong recurrence coincide. Furthermore, we discuss the generalization of positive and null recurrence to branching Markov chains and show that branching random walks on $\Z$ are either transient or positive recurrent.

Probability
Hidden tail chains and recurrence equations for dependence parameters associated with extremes of stationary higher-order Markov chains

Ioannis Papastathopoulos,Adrian Casey,Jonathan A. Tawn

DOI: https://doi.org/10.1017/apr.2024.47

IF: 1.06

2024-12-04

Advances in Applied Probability

Abstract:We derive some key extremal features for stationary kth-order Markov chains that can be used to understand how the process moves between an extreme state and the body of the process. The chains are studied given that there is an exceedance of a threshold, as the threshold tends to the upper endpoint of the distribution. Unlike previous studies with , we consider processes where standard limit theory describes each extreme event as a single observation without any information about the transition to and from the body of the distribution. Our work uses different asymptotic theory which results in non-degenerate limit laws for such processes. We study the extremal properties of the initial distribution and the transition probability kernel of the Markov chain under weak assumptions for broad classes of extremal dependence structures that cover both asymptotically dependent and asymptotically independent Markov chains. For chains with , the transition of the chain away from the exceedance involves novel functions of the k previous states, in comparison to just the single value, when . This leads to an increase in the complexity of determining the form of this class of functions, their properties, and the method of their derivation in applications. We find that it is possible to derive an affine normalization, dependent on the threshold excess, such that non-degenerate limiting behaviour of the process, in the neighbourhood of the threshold excess, is assured for all lags. We find that these normalization functions have an attractive structure that has parallels to the Yule–Walker equations. Furthermore, the limiting process is always linear in the innovations. We illustrate the results with the study of kth-order stationary Markov chains with exponential margins based on widely studied families of copula dependence structures.

statistics & probability
Subcritical Superprocesses Conditioned on Non-Extinction

Rongli Liu,Yan-Xia Ren,Renming Song,Zhenyao Sun

DOI: https://doi.org/10.1016/j.spa.2023.06.008

IF: 1.43

2023-01-01

Stochastic Processes and their Applications

Abstract:We consider a class of subcritical superprocesses (Xt)t & GE;0 with general spatial motions and general branching mechanisms. We study the asymptotic behaviors of Qt,r, the distribution of Xt conditioned on Xt+r not being a null measure. We first give the existence of limt & RARR;& INFIN; Qt,r and limr & RARR;& INFIN; Qt,r, and then show that an L log L-type condition is equivalent to the existence of the iterated limits: limr & RARR;& INFIN; limt & RARR;& INFIN; Qt,r and limt & RARR;& INFIN; limr & RARR;& INFIN; Qt,r . Finally, when the L log L-type condition holds, we show that those iterated limits, and the double limit limr,t & RARR;& INFIN; Qt,r, are the same.& COPY; 2023 Elsevier B.V. All rights reserved.
Extinction behavior and recurrence of n-type Markov branching–immigration processes

Junping Li,Juan Wang

DOI: https://doi.org/10.1186/s13661-023-01810-6

2024-01-02

Boundary Value Problems

Abstract:Abstract In this paper, we consider n -type Markov branching–immigration processes. The uniqueness criterion is first established. Then, we construct a related system of differential equations based on the branching property. Furthermore, the explicit expression of extinction probability and the mean extinction time are successfully obtained in the absorbing case by using the unique solution of the related system of differential equations and Kolmogorov forward equations. Finally, the recurrence and ergodicity criteria are given if the zero state 0 is not absorbing.

mathematics, applied
On regularity of functions of Markov chains

Steven Berghout,Evgeny Verbitskiy

DOI: https://doi.org/10.48550/arXiv.2101.00608

2021-01-03

Abstract:We consider processes which are functions of finite-state Markov chains. It is well known that such processes are rarely Markov. However, such processes are often regular in the following sense: the distant past values of the process have diminishing influence on the distribution of the present value. In the present paper, we present novel sufficient conditions for regularity of functions of Markov chains.

Probability,Dynamical Systems
Non-reversible processes: GENERIC, Hypocoercivity and fluctuations

Manh Hong Duong,Michela Ottobre

2023-01-24

Abstract:We consider two approaches to study non-reversible Markov processes, namely the Hypocoercivity Theory (HT) and GENERIC (General Equations for Non-Equilibrium Reversible-Irreversible Coupling); the basic idea behind both of them is to split the process into a reversible component and a non-reversible one, and then quantify the way in which they interact. We compare such theories and provide explicit formulas to pass from one formulation to the other; as a bi-product we give a simple proof of the link between reversibility of the dynamics and gradient flow structure of the associated Fokker-Planck equation. We do this both for linear Markov processes and for a class of nonlinear Markov process as well. We then characterize the structure of the Large deviation functional of generalised-reversible processes; this is a class of non-reversible processes of large relevance in applications. Finally, we show how our results apply to two classes of Markov processes, namely non-reversible diffusion processes and a class of Piecewise Deterministic Markov Processes (PDMPs), which have recently attracted the attention of the statistical sampling community. In particular, for the PDMPs we consider we prove entropy decay.

Mathematical Physics,Statistics Theory,Analysis of PDEs
The critical Branching Markov Chain is transient

Nina Gantert,Sebastian Mueller

DOI: https://doi.org/10.48550/arXiv.math/0510556

2005-10-26

Probability

Abstract:We investigate recurrence and transience of Branching Markov Chains (BMC) in discrete time. Branching Markov Chains are clouds of particles which move (according to an irreducible underlying Markov Chain) and produce offspring independently. The offspring distribution can depend on the location of the particle. If the offspring distribution is constant for all locations, these are Tree-Indexed Markov chains in the sense of \cite{benjamini94}. Starting with one particle at location $x$, we denote by $\alpha(x)$ the probability that $x$ is visited infinitely often by the cloud. Due to the irreducibility of the underlying Markov Chain, there are three regimes: either $\alpha(x) = 0$ for all $x$ (transient regime), or $0 < \alpha(x) < 1$ for all $x$ (weakly recurrent regime) or $\alpha(x) = 1$ for all $x$ (strongly recurrent regime). We give classification results, including a sufficient condition for transience in the general case. If the mean of the offspring distribution is constant, we give a criterion for transience involving the spectral radius of the underlying Markov Chain and the mean of the offspring distribution.
Asymptotic behaviour of a conservative reaction-diffusion system associated with a Markov process algebra model

Jie Ding,Ruiming Ma,Zhigui Lin,Zhi Ling

DOI: https://doi.org/10.48550/arXiv.2211.09298

2022-11-17

Abstract:This paper demonstrates a lower and upper solution method to investigate the asymptotic behaviour of the conservative reaction-diffusion systems associated with Markovian process algebra models. In particular, we have proved the uniform convergence of the solution to its constant equilibrium for a case study as time tends to infinity, together with experimental results illustrations.

Performance,Analysis of PDEs,Probability
Some Properties of Superprocesses Conditioned on Non-Extinction

RongLi Liu,YanXia Ren

DOI: https://doi.org/10.1007/s11425-008-0145-5

2009-01-01

Science in China Series A Mathematics

Abstract:We simply call a superprocess conditioned on non-extinction a conditioned superprocess. In this study, we investigate some properties of the conditioned superprocesses (subcritical or critical). Firstly, we give an equivalent description of the probability of the event that the total occupation time measure on a compact set is finite and some applications of this equivalent description. Our results are extensions of those of Krone (1995) from particular branching mechanisms to general branching mechanisms. We also prove a claim of Krone for the cases of d = 3, 4. Secondly, we study the local extinction property of the conditioned binary super-Brownian motion {X t , P µ ∞ }. When d = 1, as t goes to infinity, X t /$\sqrt t $ converges to ηλ in weak sense under P µ ∞ , where η is a nonnegative random variable and λ is the Lebesgue measure on ℝ. When d ⩾ 2, the conditioned binary super-Brownian motion is locally extinct under P µ ∞ .
On polynomial recurrence property of "Markov-up" processes

Diana Kalikaeva

2024-06-28

Abstract:This work is a continuation of [Kalikaeva, MPRF, 23(2):225-240]. The object of study is ``Markov-up processes'' on $\mathbb Z_+$ and the moment of downcrossing a certain barrier. The processes considered in this paper differ from Markov ones by the presence of a memory in certain parts of the trajectory. In our previous paper [Kalikaeva, MPRF, 23(2):225-240] exponential recurrence conditions were established. In this paper polynomial recurrence properties are considered under certain new assumptions.

Probability
The first returning speed and the last exit speed of a type of Markov chain

Huizeng Zhang,Minzhi zhao,Lei wang

DOI: https://doi.org/10.48550/arXiv.1101.1161

2011-01-06

Abstract:Let $\{X_n\}$ be a Markov chain with transition probability $p_{ij}=a_{j-(i-1)^+},\forall i,j\ge 0$, where $a_j=0$ provided $j<0$, $a_0>0$, $a_0+a_1<1$ and $\sum_{n=0}^\infty a_n=1$. Let $\mu=\sum_{n=1}^\infty na_n$. It's known that $\{X_n\}$ is positive recurrent when $\mu<1$; is null recurrent when $\mu=1$; and is transient when $\mu>1$. In this paper, we shall discuss the first returning speed and the last exit speed more precisely by means of $\{a_n\}$

Probability
In Markov process, an extremal reversible measure is an extremal invariant measure

Hiroki Yagisita

DOI: https://doi.org/10.48550/arXiv.2312.14816

2023-08-15

Abstract:We consider a discrete-time temporally-homogeneous conservative Markov process. We show that extremality of reversible measure implies extremality of invariant measure. Using analogue of Dirichlet form, we modify a proof that in stochastic Ising model (Glauber dynamics), an extreme Gibbs state is an extreme invariant measure.

General Mathematics
The jumping properties of Markov branching processes

Yanyun Li,Junping Li

DOI: https://doi.org/10.48550/arXiv.2004.09261

2022-10-28

Abstract:It is well-known that 0 is the absorbing state for a branching system. Each particle in the system lives a random long time and gives a random number of new particles at its death time. It stops when the system has no particle. This paper is devoted to studying the fixed range crossing numbers until any time t. The joint probability distribution of fixed range crossing numbers of such processes until time t is obtained by using a new method. In particular, the probability distribution of total death number is given for Markov branching processes until time t.

Probability
Quasi-processes for branching Markov chains

Steffen Dereich,Martin Maiwald

2023-11-06

Abstract:Potential theory is a central tool to understand and analyse Markov processes. In this article, we develop its probabilistic counterpart for branching Markov chains. Specifically, we examine versions of quasi-processes or interlacements that incorporate branching, referred to as branching quasi-processes. These processes are characterized by their occupation measures. If a certain decorability condition is fulfilled, there's an isomorphism between the set of branching quasi-processes and the set of excessive measures, where the excessive measures correspond to the occupation measures of the branching quasi-processes. Utilizing a branching quasi-process as an intensity measure for a Poisson point process leads to the formulation of random interlacements with branching. In cases where individuals reproduce with an average rate of one or less, we detail a construction that draws on classical interlacements. Our approach significantly employs the additive structure of branching Markov chains, with the spinal representation of the branching processes serving as a crucial technical tool.

Probability
ABSOLUTE CONTINUITIES OF EXIT MEASURES AND TOTAL WEIGHTED OCCUPATION TIME MEASURES FOR SUPER-α-STABLE PROCESSES

J Zhang,YX Ren

DOI: https://doi.org/10.1016/s0252-9602(06)60058-1

2006-01-01

Abstract:Suppose X is a super-alpha-stable process in R-d, (0 < alpha < 2), whose branching rate function is dt, and branching mechanism is of the form Psi(z) = z(1+beta) (0 < beta <= 1). Let X-tau and Y-tau denote the exit measure and the total weighted occupation time measure of X in a bounded smooth domain D, respectively. The absolute continuities of X-tau and Y-tau are discussed.
Limit Theorems for a Class of Critical Superprocesses with Stable Branching

Yan-Xia Ren,Renming Song,Zhenyao Sun

DOI: https://doi.org/10.1016/j.spa.2020.01.001

IF: 1.43

2020-01-01

Stochastic Processes and their Applications

Abstract:We consider a critical superprocess {X;Pμ} with general spatial motion and spatially dependent stable branching mechanism with lowest stable index γ0>1. We first show that, under some conditions, Pμ(|Xt|≠0) converges to 0 as t→∞ and is regularly varying with index (γ0−1)−1. Then we show that, for a large class of non-negative testing functions f, the distribution of {Xt(f);Pμ(⋅|‖Xt‖≠0)}, after appropriate rescaling, converges weakly to a positive random variable z(γ0−1) with Laplace transform E[e−uz(γ0−1)]=1−(1+u−(γ0−1))−1∕(γ0−1).

Α–transience and Α–recurrence of Right Processes

Α-Transience AND Α-Recurrence FOR RANDOM WALKS AND LÉVY PROCESSES

n-type Markov Branching Processes with Immigration

Renewal and Regenerative Processes: short review

Transience and Recurrence of Markov Processes with Constrained Local Time

Recurrence for branching Markov chains

Hidden tail chains and recurrence equations for dependence parameters associated with extremes of stationary higher-order Markov chains

Subcritical Superprocesses Conditioned on Non-Extinction

Extinction behavior and recurrence of n-type Markov branching–immigration processes

On regularity of functions of Markov chains

Non-reversible processes: GENERIC, Hypocoercivity and fluctuations

The critical Branching Markov Chain is transient

Asymptotic behaviour of a conservative reaction-diffusion system associated with a Markov process algebra model

Some Properties of Superprocesses Conditioned on Non-Extinction

On polynomial recurrence property of "Markov-up" processes

The first returning speed and the last exit speed of a type of Markov chain

In Markov process, an extremal reversible measure is an extremal invariant measure

The jumping properties of Markov branching processes

Quasi-processes for branching Markov chains

ABSOLUTE CONTINUITIES OF EXIT MEASURES AND TOTAL WEIGHTED OCCUPATION TIME MEASURES FOR SUPER-α-STABLE PROCESSES

Limit Theorems for a Class of Critical Superprocesses with Stable Branching