Abstract:The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations that describes the evolution of probability density for each population vector in the state-space of the stochastic reaction dynamics. For many examples of interest, this state-space is infinite, making it difficult to obtain exact solutions of the CME. To deal with this problem, the Finite State Projection (FSP) algorithm was developed by Munsky and Khammash (Jour. Chem. Phys. 2006), to provide approximate solutions to the CME by truncating the state-space. The FSP works well for finite time-periods but it cannot be used for estimating the stationary solutions of CMEs, which are often of interest in systems biology. The aim of this paper is to develop a version of FSP which we refer to as the stationary FSP (sFSP) that allows one to obtain accurate approximations of the stationary solutions of a CME by solving a finite linear-algebraic system that yields the stationary distribution of a continuous-time Markov chain over the truncated state-space. We derive bounds for the approximation error incurred by sFSP and we establish that under certain stability conditions, these errors can be made arbitrarily small by appropriately expanding the truncated state-space. We provide several examples to illustrate our sFSP method and demonstrate its efficiency in estimating the stationary distributions. In particular, we show that using a quantised tensor train (QTT) implementation of our sFSP method, problems admitting more than 100 million states can be efficiently solved.

Obtaining the long-term behavior of Master equations with finite state space from the structure of the associated state transition network

A spectral theorem for the semigroup generated by a class of infinitely many master equations

Master equations for finite state mean field games with nonlinear activations

Mean field games master equations: from discrete to continuous state space

Master Equation for Finite State Mean Field Games with Additive Common Noise

Approach to Equilibrium in Nano-Scale Systems at Finite Temperature

A standard form of master equations for general non-Markovian jump processes: the Laplace-space embedding framework and asymptotic solution

Local Master Equation for Small Temperatures

Analysis of the Finite-State Ergodic Master Equation

Computing the moments of high dimensional solutions of the master equation

Fundamental Facts Concerning Reversible Master Equations

Time dependent Markovian master equation beyond the adiabatic limit

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Equilibrium master equations for time-inconsistent problems with distribution dependent rewards

Master Stability Functions of Networks of Izhikevich Neurons

Flow on sweeping networks

On some mean field games and master equations through the lens of conservation laws

Dynamics of the Chemical Master Equation, a strip of chains of equations in d-dimensional space

On The Interpretation Of The Master Equation

A finite state projection algorithm for the stationary solution of the chemical master equation