Yannis Pantazis,Markos A. Katsoulakis,Dionisios G. Vlachos
Abstract:Stochastic modeling and simulation provide powerful predictive methods for the intrinsic understanding of fundamental mechanisms in complex biochemical networks. Typically, such mathematical models involve networks of coupled jump stochastic processes with a large number of parameters that need to be suitably calibrated against experimental data. In this direction, the parameter sensitivity analysis of reaction networks is an essential mathematical and computational tool, yielding information regarding the robustness and the identifiability of model parameters. However, existing sensitivity analysis approaches such as variants of the finite difference method can have an overwhelming computational cost in models with a high-dimensional parameter space. We develop a sensitivity analysis methodology suitable for complex stochastic reaction networks with a large number of parameters. The proposed approach is based on Information Theory methods and relies on the quantification of information loss due to parameter perturbations between time-series distributions. For this reason, we need to work on path-space, i.e., the set consisting of all stochastic trajectories, hence the proposed approach is referred to as "pathwise". The pathwise sensitivity analysis method is realized by employing the rigorously-derived Relative Entropy Rate (RER), which is directly computable from the propensity functions. A key aspect of the method is that an associated pathwise Fisher Information Matrix (FIM) is defined, which in turn constitutes a gradient-free approach to quantifying parameter sensitivities. The structure of the FIM turns out to be block-diagonal, revealing hidden parameter dependencies and sensitivities in reaction networks.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to conduct parameter sensitivity analysis in complex biochemical reaction networks. Specifically, the paper focuses on how to effectively conduct parameter sensitivity analysis in complex stochastic reaction networks with a large number of parameters. Traditional methods such as the finite - difference method may face huge computational costs when dealing with high - dimensional parameter spaces. Therefore, the paper proposes a new method based on path information theory to solve this problem.
### Main contributions of the paper
1. **Proposing a new method**: The paper proposes a path - sensitivity analysis method based on the Relative Entropy Rate (RER). This method provides a new sensitivity analysis tool by quantifying the information loss between path distributions caused by parameter perturbations.
2. **Path Fisher Information Matrix (FIM)**: The paper defines a path - related Fisher Information Matrix (FIM) that does not require gradient information and is suitable for high - dimensional parameter spaces. The block - diagonal structure of the FIM reveals the dependence relationships between parameters, which is helpful for parameter identification and the study of system robustness.
3. **Application verification**: The paper tests and verifies the proposed method on three biochemical systems, including:
- Protein production and degradation model: This model has an explicit solution and can be used to evaluate the effectiveness of the method.
- p53 reaction network: This network exhibits stochastic oscillations, and traditional continuous approximation methods (such as linear noise approximation) may fail in this case.
- Epidermal Growth Factor Receptor (EGFR) model: This is a high - dimensional system, containing 94 species and 207 reactions, and the dimension of the parameter space is 207.
### Method overview
1. **Relative entropy**: Relative entropy (or Kullback - Leibler divergence) is used to quantify the information loss between two probability distributions. In the path space, relative entropy can be expressed as:
\[
R(Q_\theta^{[0,T]} \mid Q_{\theta+\epsilon}^{[0,T]}) = \int \log \left( \frac{dQ_\theta^{[0,T]}}{dQ_{\theta+\epsilon}^{[0,T]}} \right) dQ_\theta^{[0,T]}
\]
2. **Relative entropy rate**: The Relative Entropy Rate (RER) is the time - average of relative entropy and is used to measure the long - term information loss caused by parameter perturbations:
\[
H(Q_\theta \mid Q_{\theta+\epsilon}) = \lim_{T \to \infty} \frac{1}{T} R(Q_\theta^{[0,T]} \mid Q_{\theta+\epsilon}^{[0,T]})
\]
The explicit expression of RER is:
\[
H(Q_\theta \mid Q_{\theta+\epsilon}) = E_{\mu_\theta} \left[ \sum_{j = 1}^M a_j^\theta(x) \log \frac{a_j^\theta(x)}{a_j^{\theta+\epsilon}(x)} - (a_0^\theta(x) - a_0^{\theta+\epsilon}(x)) \right]
\]
3. **Path Fisher Information Matrix**: The path FIM is the Hessian matrix of RER and is used to quantify the local sensitivity of path distributions:
\[
F_H(Q_\theta) = E_{\mu_\theta} \left[ \sum_{j = 1}^M a_j^\theta(x) \nabla_\theta \log a_j^\theta(x) (\nabla_\theta \log a_j^\theta(x))^T \right]
\]
The block - diagonal structure of the FIM reveals the dependence relationships between parameters, which is helpful for parameter identification