Abstract:Understanding the control of cellular networks consisting of gene and protein interactions and their emergent properties is a central activity of Systems Biology research. For this, continuous, discrete, hybrid, and stochastic methods have been proposed. Currently, the most common approach to modelling accurate temporal dynamics of networks is ordinary differential equations (ODE). However, critical limitations of ODE models are difficulty in kinetic parameter estimation and numerical solution of a large number of equations, making them more suited to smaller systems. In this article, we introduce a novel recurrent artificial neural network (RNN) that addresses above limitations and produces a continuous model that easily estimates parameters from data, can handle a large number of molecular interactions and quantifies temporal dynamics and emergent systems properties. This RNN is based on a system of ODEs representing molecular interactions in a signalling network. Each neuron represents concentration change of one molecule represented by an ODE. Weights of the RNN correspond to kinetic parameters in the system and can be adjusted incrementally during network training. The method is applied to the p53-Mdm2 oscillation system - a crucial component of the DNA damage response pathways activated by a damage signal. Simulation results indicate that the proposed RNN can successfully represent the behaviour of the p53-Mdm2 oscillation system and solve the parameter estimation problem with high accuracy. Furthermore, we presented a modified form of the RNN that estimates parameters and captures systems dynamics from sparse data collected over relatively large time steps. We also investigate the robustness of the p53-Mdm2 system using the trained RNN under various levels of parameter perturbation to gain a greater understanding of the control of the p53-Mdm2 system. Its outcomes on robustness are consistent with the current biological knowledge of this system. As more quantitative data become available on individual proteins, the RNN would be able to refine parameter estimation and mapping of temporal dynamics of individual signalling molecules as well as signalling networks as a system. Moreover, RNN can be used to modularise large signalling networks.

Integrating Residual Networks and Symbolic Regression for Biological ODE System Modeling

Learning Interpretable Network Dynamics via Universal Neural Symbolic Regression

Neural Symbolic Regression of Complex Network Dynamics

Symbolic regression via neural networks

Modeling and Analyzing Biological Oscillations in Molecular Networks

Biologically informed NeuralODEs for genome-wide regulatory dynamics

Data-Driven Modeling of Partially Observed Biological Systems

Implicit regularization of deep residual networks towards neural ODEs

Reverse engineering gene regulatory network based on complex-valued ordinary differential equation model

Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery

Sparse Additive Ordinary Differential Equations for Dynamic Gene Regulatory Network Modeling

Explaining deep residual networks predictions with symplectic adjoint method

Novel recurrent neural network for modelling biological networks: oscillatory p53 interaction dynamics

High Dimensional ODEs Coupled with Mixed-Effects Modeling Techniques for Dynamic Gene Regulatory Network Identification

Modeling Power Systems Dynamics with Symbolic Physics-Informed Neural Networks

Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression

Revealing Complex Ecological Dynamics via Symbolic Regression

Deep Learning and Symbolic Regression for Discovering Parametric Equations

Statistical Model Checking based Analysis of Biological Networks

Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families

Neural Generalized Ordinary Differential Equations with Layer-varying Parameters