Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

Solving differential equations with unknown constitutive relations as recurrent neural networks

Learning Interactions in Reaction Diffusion Equations by Neural Networks

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Computational characteristics of feedforward neural networks for solving a stiff differential equation

Learning kinetics from non-ideal reactors by implicitly solved finite volumes and global reaction neural networks

Unsupervised Reservoir Computing for Solving Ordinary Differential Equations

Solving Second-Order Nonlinear Evolution Partial Differential Equations Using Deep Learning*

Design, Verification, and Application of New Discrete-Time Recurrent Neural Network for Dynamic Nonlinear Equations Solving

Neural network Approximations for Reaction-Diffusion Equations -- Homogeneous Neumann Boundary Conditions and Long-time Integrations

A Recurrent Neural Network for Solving Sylvester Equation with Time-Varying Coefficients

Neural-PDE: a RNN Based Neural Network for Solving Time Dependent PDEs

Solving differential equations with neural networks: Applications to the calculation of cosmological phase transitions

Design and Analysis of a Novel Integral Recurrent Neural Network for Solving Time-Varying Sylvester Equation

Solving Irregular and Data-enriched Differential Equations using Deep Neural Networks

Neural-network solutions to stochastic reaction networks

Solving the Reaction-Diffusion equation based on analytical methods and deep learning algorithm; the Case study of sulfate attack to concrete

General solutions for nonlinear differential equations: a rule-based self-learning approach using deep reinforcement learning

Finite Difference Nets: A Deep Recurrent Framework for Solving Evolution PDEs

Recurrent neural networks for dynamical systems: Applications to ordinary differential equations, collective motion, and hydrological modeling

Learning nonlinear integral operators via Recurrent Neural Networks and its application in solving Integro-Differential Equations

Learning the flux and diffusion function for degenerate convection-diffusion equations using different types of observations