Abstract:We study continuous-time Markov chains on the non-negative integers under mild regularity conditions (in particular, the set of jump vectors is finite and both forward and backward jumps are possible). Based on the so-called flux balance equation, we derive an iterative formula for calculating stationary measures. Specifically, a stationary measure $\pi(x)$ evaluated at $x\in\mathbb{N}_0$ is represented as a linear combination of a few generating terms, similarly to the characterization of a stationary measure of a birth-death process, where there is only one generating term, $\pi(0)$. The coefficients of the linear combination are recursively determined in terms of the transition rates of the Markov chain. For the class of Markov chains we consider, there is always at least one stationary measure (up to a scaling constant). We give various results pertaining to uniqueness and non-uniqueness of stationary measures, and show that the dimension of the linear space of signed invariant measures is equal to the number of generating terms. A minimization problem is constructed in order to compute stationary measures numerically. Moreover, a heuristic linear approximation scheme is suggested for the same purpose by first approximating the generating terms. The correctness of the linear approximation scheme is justified in some special cases. Furthermore, a decomposition of the state space into different types of states (open and closed irreducible classes, and trapping, escaping and neutral states) is presented. Applications to stochastic reaction networks are well illustrated.

Markov chain approximations to singular stable-like processes

Markov Chain Approximations to Singular Stable-like Processes

Strong Approximation for A Class of Stationary Processes

STRONG APPROXIMATION OF A MARKOV CHAIN

Markov Chain Approximation of Pure Jump Processes

The Invariance Principle for Some Class of Markov Chains

Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

Stable limits for Markov chains via the Principle of Conditioning

Markov Chains Approximations of jump-Diffusion Quantum Trajectories

Approximating Markov Processes Through Filtration

Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

A functional limit theorem for coin tossing Markov chains

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Weak Convergence to Stochastic Integrals Driven by Α-Stable Lévy Processes

Approximation for the invariant measure with applications for jump processes (convergence in total variation distance)

On regularity of functions of Markov chains

Asymptotic Stability in Probability of Singular Stochastic Systems with Markovian Switchings

Markov chain approximations for one dimensional diffusions

Compressibility and Stochastic Stability of Monotone Markov Chain

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Asymptotic properties for linear processes of functionals of reversible Markov Chains