Abstract:Background: The identification of genetic regulatory networks (GRNs) provides insights into complex cellular processes. A class of recurrent neural networks (RNNs) captures the dynamics of GRN. Algorithms combining the RNN and machine learning schemes were proposed to reconstruct small-scale GRNs using gene expression time series. Results: We present new GRN reconstruction methods with neural networks. The RNN is extended to a class of recurrent multilayer perceptrons (RMLPs) with latent nodes. Our methods contain two steps: the edge rank assignment step and the network construction step. The former assigns ranks to all possible edges by a recursive procedure based on the estimated weights of wires of RNN/RMLP (RERNN/RERMLP), and the latter constructs a network consisting of top-ranked edges under which the optimized RNN simulates the gene expression time series. The particle swarm optimization (PSO) is applied to optimize the parameters of RNNs and RMLPs in a two-step algorithm. The proposed RERNN-RNN and RERMLP-RNN algorithms are tested on synthetic and experimental gene expression time series of small GRNs of about 10 genes. The experimental time series are from the studies of yeast cell cycle regulated genes and E. coli DNA repair genes. Conclusion: The unstable estimation of RNN using experimental time series having limited data points can lead to fairly arbitrary predicted GRNs. Our methods incorporate RNN and RMLP into a two-step structure learning procedure. Results show that the RERMLP using the RMLP with a suitable number of latent nodes to reduce the parameter dimension often result in more accurate edge ranks than the RERNN using the regularized RNN on short simulated time series. Combining by a weighted majority voting rule the networks derived by the RERMLP-RNN using different numbers of latent nodes in step one to infer the GRN, the method performs consistently and outperforms published algorithms for GRN reconstruction on most benchmark time series. The framework of two-step algorithms can potentially incorporate with different nonlinear differential equation models to reconstruct the GRN.

Synthesis and Analysis of Elementary Algorithms for a Differential Neural Computer

Hybrid computing using a neural network with dynamic external memory

Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysis

Differentiable Neural Computers with Memory Demon

A survey on dendritic neuron model: Mechanisms, algorithms and practical applications

A Brain-inspired Memory Transformation based Differentiable Neural Computer for Reasoning-based Question Answering

The advance of neural ordinary differential ordinary differential equations

Resistive Memory-based Neural Differential Equation Solver for Score-based Diffusion Model

TYURINGMACHINE AND ARTIFICIAL NEURAL NETWORKS

Neural Differential Algebraic Equations

A Study of the Mathematics of Deep Learning

Discrete Neural Algorithmic Reasoning

Artificial immune system training algorithm for a dendritic neuron model

Reconstructing Genetic Regulatory Networks Using Two-Step Algorithms with the Differential Equation Models of Neural Networks

On Neural Differential Equations

Dual-mode Dendritic Devices Enhanced Neural Network Based on Electrolyte Gated Transistors

Dual Algorithmic Reasoning

A short note on the decision tree based neural turing machine

Theoretical formulation and analysis of the deterministic dendritic cell algorithm

Recurrent Neural Networks in the Eye of Differential Equations

A Differential Topological View of Challenges in Learning with Feedforward Neural Networks.