Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

A Deep Learning Method For Solving Third-Order Nonlinear Evolution Equations

Solving Second-Order Nonlinear Evolution Partial Differential Equations Using Deep Learning*

A deep learning method for solving high-order nonlinear soliton equation

Soliton, Breather and Rogue Wave Solutions for Solving the Nonlinear Schrödinger Equation Using a Deep Learning Method with Physical Constraints

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

Solving Non-linear Kolmogorov Equations in Large Dimensions by Using Deep Learning: A Numerical Comparison of Discretization Schemes

A Physics-Constrained Deep Residual Network for Solving the Sine-Gordon Equation

The New Simulation of Quasiperiodic Wave, Periodic Wave, and Soliton Solutions of the KdV-mKdV Equation via a Deep Learning Method

Data-driven solitons dynamics and parameters discovery in the generalized nonlinear dispersive mKdV-type equation via deep neural networks learning

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Deep-learning of parametric partial differential equations from sparse and noisy data

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

Finite Difference Nets: A Deep Recurrent Framework for Solving Evolution PDEs

Solving High-Dimensional Partial Differential Equations Using Deep Learning.

A Non-Gradient Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks.

General solutions for nonlinear differential equations: a rule-based self-learning approach using deep reinforcement learning

Data-driven discoveries of Bäcklund transforms and soliton evolution equations via deep neural network learning schemes

A deep branching solver for fully nonlinear partial differential equations

Data-driven solutions and parameter discovery of the nonlocal mKdV equation via deep learning method

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks