Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

First Order System Least Squares Neural Networks

A Least-Squares-Based Neural Network (LS-Net) for Solving Linear Parametric PDEs

Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs

Error estimates of residual minimization using neural networks for linear PDEs

Some elliptic second order problems and neural network solutions: Existence and error estimates

Least-Squares Neural Network (LSNN) Method For Linear Advection-Reaction Equation: Discontinuity Interface

Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations

A Stable and Scalable Method for Solving Initial Value PDEs with Neural Networks

Least-Squares ReLU Neural Network (LSNN) Method for Linear Advection-Reaction Equation

A feedforward neural network framework for approximating the solutions to nonlinear ordinary differential equations

Least-Squares ReLU Neural Network (LSNN) Method for Scalar Nonlinear Hyperbolic Conservation Law

Optimally weighted loss functions for solving PDEs with Neural Networks

Deep learning of first-order nonlinear hyperbolic conservation law solvers

Least-Squares Neural Network (LSNN) Method For Linear Advection-Reaction Equation: Non-constant Jumps

Convolutional Neural Networks for Very Low-Dimensional LPV Approximations of Incompressible Navier-Stokes Equations

A Deep Learning Framework for Solving Hyperbolic Partial Differential Equations: Part I

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Adaptive quadratures for nonlinear approximation of low-dimensional PDEs using smooth neural networks

A Deep Learning approach to Reduced Order Modelling of Parameter Dependent Partial Differential Equations

Solving multiscale elliptic problems by sparse radial basis function neural networks