Abstract:A rigorous and largely self-contained account of (a) the bread-and-butter concepts and techniques in Markov chain theory and (b) the long-term behaviour of chains. As much as possible, the treatment is probabilistic instead of analytical (I stay away from semigroup theory). Personally, I tend to find that the intuition lies with the former and not the latter. This manuscript is geared towards those interested in the use of Markov chains as models of real-life phenomena. For this reason, I focus on the type of chains most commonly encountered in practice (time-homogeneous, minimal, and right-continuous in the discrete topology) and choose a starting point very familiar to this audience: the (Kendall-) Gillespie Algorithm commonly used to simulate these chains. In order to keep the prerequisite knowledge and technical complications to a minimum, I take a 'bare-bones' approach that keeps the focus on chains (instead of more general processes) to an almost pathological degree: I use the 'jump and hold' structure of chains extensively; almost no martingale theory; minimal coupling; no stochastic calculus; and, even though regeneration and renewal (of course!) feature in the manuscript, they do so exclusively in the context of chains. I have also taken some extra steps to avoid imposing certain assumptions encountered in other texts that sometimes prove to be stumbling blocks in practice (e.g., irreducibility of the state space, boundedness of test functions and of stopping times). For more details, see the preface.

The critical Branching Markov Chain is transient

Recurrence for branching Markov chains

The jumping properties of Markov branching processes

Transience and Recurrence of Markov Processes with Constrained Local Time

An inhomogeneous controlled branching process

Central limit theorem for bifurcating Markov chains under point-wise ergodic conditions

Dynamical sensitivity of recurrence and transience of branching random walks

The Key Renewal Theorem for a Transient Markov Chain

Markov chains revisited

Long-time behaviour of a multidimensional age-dependent branching process with a singular jump kernel

Extinction behavior and recurrence of n-type Markov branching–immigration processes

A moment approach for the convergence of spatial branching processes to the Continuum Random Tree

Immortal Branching Processes

Critical Age Dependent Branching Markov Processes and Their Scaling Limits

Quasi-stationary distributions for subcritical branching Markov chains

Branching structure for the transient (1;R)-random walk in random environment and its applications

Theta-positive branching in varying environment

Local stability in a transient Markov chain

Branching structure for the transient random walk on a strip in a random environment

A transient Markov chain with finitely many cutpoints

Coalescent point process of branching trees in varying environment