Abstract:Significance Modeling intracellular processes has long relied on the markovian assumption. However, as soon as a reactant interacts with its environment, molecular memory definitely exists and its effects cannot be neglected. Since the Markov theory cannot translate directly to modeling and analysis of nonmarkovian processes, this leads to many significant challenges. We develop a formulation, namely the stationary generalized chemical-master equation, to model intracellular processes with molecular memory. This formulation converts a nonmarkovian question to a markovian one while keeping the stationary probabilistic behavior unchanged. Both a stationary generalized Fokker–Planck equation and a generalized linear noise approximation are further developed for the fast evaluation of fluctuations. These formulations can have broad applications and may help us discover new biological knowledge. Many cellular processes are governed by stochastic reaction events. These events do not necessarily occur in single steps of individual molecules, and, conversely, each birth or death of a macromolecule (e.g., protein) could involve several small reaction steps, creating a memory between individual events and thus leading to nonmarkovian reaction kinetics. Characterizing this kinetics is challenging. Here, we develop a systematic approach for a general reaction network with arbitrary intrinsic waiting-time distributions, which includes the stationary generalized chemical-master equation (sgCME), the stationary generalized Fokker–Planck equation, and the generalized linear-noise approximation. The first formulation converts a nonmarkovian issue into a markovian one by introducing effective transition rates (that explicitly decode the effect of molecular memory) for the reactions in an equivalent reaction network with the same substrates but without molecular memory. Nonmarkovian features of the reaction kinetics can be revealed by solving the sgCME. The latter 2 formulations can be used in the fast evaluation of fluctuations. These formulations can have broad applications, and, in particular, they may help us discover new biological knowledge underlying memory effects. When they are applied to generalized stochastic models of gene-expression regulation, we find that molecular memory is in effect equivalent to a feedback and can induce bimodality, fine-tune the expression noise, and induce switch.

Gaussian Markov Transition Models of Molecular Kinetics

Markov-type state models to describe non-Markovian dynamics

Markov Models of Molecular Kinetics: Generation and Validation

Projected and Hidden Markov Models for Calculating Kinetics and Metastable States of Complex Molecules

Variational Approximation of Molecular Kinetics from Short Off-Equilibrium Simulations

Tutorials on How to Build Non-Markovian Dynamic Models from Molecular Dynamics Simulations for Studying Protein Dynamics

Markov field models: Scaling molecular kinetics approaches to large molecular machines

Variational Koopman Models: Slow Collective Variables and Molecular Kinetics from Short Off-Equilibrium Simulations.

Combining Experimental and Simulation Data of Molecular Processes Via Augmented Markov Models

Information Bottleneck Approach for Markov Model Construction

Optimal Data-Driven Estimation of Generalized Markov State Models for Non-Equilibrium Dynamics.

Projected Metastable Markov Processes and Their Estimation with Observable Operator Models.

Markovian Approaches to Modeling Intracellular Reaction Processes with Molecular Memory

Virtual Molecular Dynamics

A quantitative study on the approximation error and speed-up of the multi-scale MCMC (Monte Carlo Markov chain) method for molecular dynamics

Model reduction techniques for the computation of extended Markov parameterizations for generalized Langevin equations

Hierarchical Markov State Model Building to Describe Molecular Processes

Accurate estimates of dynamical statistics using memory

Post-Markovian master equation à la microscopic collisional model

A tutorial on pharmacometric Markov models

Automated detection of many-particle solvation states for accurate characterizations of diffusion kinetics