Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

Solving Falkner-Skan type equations via Legendre and Chebyshev Neural Blocks

deepFDEnet: A Novel Neural Network Architecture for Solving Fractional Differential Equations

A reduced order Schwarz method for nonlinear multiscale elliptic equations based on two-layer neural networks

Solving Fokker-Planck equations using the zeros of Fokker-Planck operators and the Feynman-Kac formula

Non-equispaced Fourier Neural Solvers for PDEs

Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

Deep FBSDE Neural Networks for Solving Incompressible Navier-Stokes Equation and Cahn-Hilliard Equation

Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep Learning

Symbolically Solving Partial Differential Equations using Deep Learning

Feynman-Kac Formula for Nonlinear Schrödinger Equations with Applications in Numerical Approximations

Deep neural network for solving differential equations motivated by Legendre-Galerkin approximation

Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion Monte Carlo like approach

Actor-Critic Algorithm for High-dimensional Partial Differential Equations

Deep Neural Network Solutions for Oscillatory Fredholm Integral Equations

Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations

Solving multiscale elliptic problems by sparse radial basis function neural networks

Solving Fredholm Integral Equations Using Deep Learning

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Spectral Function Space Learning and Numerical Linear Algebra Networks for Solving Linear Inverse Problems

Quadratic Neural Networks for Solving Inverse Problems

Hybrid Neural Networks for Solving Fully Coupled, High-Dimensional Forward–Backward Stochastic Differential Equations