A path method for non-exponential ergodicity of Markov chains and its application for chemical reaction systems

Minjoon Kim,Jinsu Kim
2024-02-08
Abstract:In this paper, we present criteria for non-exponential ergodicity of continuous-time Markov chains on a countable state space. These criteria can be verified by examining the ratio of transition rates over certain paths. We applied this path method to explore the non-exponential convergence of microscopic biochemical interacting systems. Using reaction network descriptions, we identified special architectures of biochemical systems for non-exponential ergodicity. In essence, we found that reactions forming a cycle in the reaction network can induce non-exponential ergodicity when they significantly dominate other reactions across infinitely many regions of the state space. Interestingly, the special architectures allowed us to construct many detailed balanced and complex balanced biochemical systems that are non-exponentially ergodic. Some of these models are low-dimensional bimolecular systems with few reactions. Thus this work suggests the possibility of discovering or synthesizing stochastic systems arising in biochemistry that possess either detailed balancing or complex balancing and slowly converge to their stationary distribution.
Probability
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to determine whether a continuous - time Markov chain has non - exponential ergodicity on a countable state space, and apply it to chemical reaction systems to explore the non - exponential convergence behavior of microscopic biochemical interaction systems. Specifically, the author proposes a path - based method to verify the non - exponential ergodicity of continuous - time Markov chains. By examining the ratio of transition rates on certain paths, these conditions can be verified. In addition, the author applies this method to chemical reaction networks, identifies special architectures that lead to non - exponential ergodicity, and discovers some biochemical systems of detailed balance and complex balance, which slowly converge to their steady - state distributions. The following are the key points in the paper: 1. **Problem Background**: - A continuous - time Markov chain (CTMC) is usually exponentially ergodic on a finite irreducible state space. - However, in a countably infinite state space, there are cases where exponential ergodicity is not guaranteed, especially in stochastically modeled biochemical systems. 2. **Proposed Method**: - The author proposes new sufficient conditions to prove the non - exponential ergodicity of continuous - time Markov chains on a countable state space. - These conditions indicate that if there are a series of paths in the state space such that the Markov chain will stay for a long time once it enters these paths, then the chain is non - exponential ergodic. 3. **Application Areas**: - Apply these conditions to chemical reaction networks to identify the types of biochemical systems with non - exponential ergodicity. - In particular, when there are reactions forming cycles in the reaction network, the dominance of these reactions in the network will lead to non - exponential ergodicity. 4. **Theoretical Basis**: - Use path probabilities and moment - generating functions to quantify the behavior of Markov chains on specific paths. - Propose the concept of a strong tier - 1 cycle to describe the structural features in the reaction network that lead to non - exponential ergodicity. 5. **Conclusions and Prospects**: - Through the above methods, the author has found many different non - exponential ergodic stochastic biochemical systems, which are either in detailed balance or in complex balance. - The study also discusses the relationship between these results and the spectral gap and congestion ratio, which are usually used to prove exponential ergodicity. In summary, this paper aims to provide a new method to analyze and identify biochemical systems with non - exponential ergodicity, which is of great significance for understanding the dynamic behavior of complex biochemical processes.