Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

Application of three unsupervised neural network models to singular nonlinear BVP of transformed 2D Bratu equation

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Comparison of three unsupervised neural network models for first Painlevé Transcendent

Application of multivariate bilinear neural network method to fractional partial differential equations

Gudermannian Neural Networks for Two-Point Nonlinear Singular Model Arising in the Thermal-Explosion Theory

Lump solution, interaction solution, and interference wave for the (3+1)-dimensional BKP-Boussinesq equation as well as analysis of BNNM model degradation

Neural networks for bifurcation and linear stability analysis of steady states in partial differential equations

Radial basis function neural network for solution of two-dimensional burgers' equation

A New Neural Network Model And Its Application

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Distributed Neurodynamic Models for Solving a Class of System of Nonlinear Equations

Neural Network Algorithm for Solving Nonlinear Equation Systems.

Simulating accurate and effective solutions of some nonlinear nonlocal two-point BVPs: Clique and QLM-clique matrix methods

Application of neural network modeling methods in solving initial boundary value problems for partial differential equations

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Legendre Neural Network Method for Several Classes of Singularly Perturbed Differential Equations Based on Mapping and Piecewise Optimization Technology

The exact analytical solutions of the [math]-dimensional extended Korteweg–de Vries equation using bilinear neural network method and bilinear residual network method

Neural Network Approach for Solving Nonsingular Multi-Linear Tensor Systems

Fractal Solitons, Arbitrary Function Solutions, Exact Periodic Wave and Breathers for a Nonlinear Partial Differential Equation by Using Bilinear Neural Network Method

A novel computing stochastic algorithm to solve the nonlinear singular periodic boundary value problems

Solving High Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators