Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

Mastering the Cahn–Hilliard Equation and Camassa–Holm Equation with Cell-Average Based Neural Network Method

Cell-average based neural network method for high dimensional parabolic differential equations

Cell-average based neural network method for hyperbolic and parabolic partial differential equations

Mass-preserving Spatio-temporal adaptive PINN for Cahn-Hilliard equations with strong nonlinearity and singularity

Numerical approximation based on deep convolutional neural network for high‐dimensional fully nonlinear merged PDEs and 2BSDEs

The high-order exponential semi-implicit scalar auxiliary variable approach for nonlocal Cahn-Hilliard equation

Deep FBSDE Neural Networks for Solving Incompressible Navier-Stokes Equation and Cahn-Hilliard Equation

An efficient data assimilation based unconditionally stable scheme for Cahn–Hilliard equation

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Evolving Neural Network (ENN) Method for One-Dimensional Scalar Hyperbolic Conservation Laws: I Linear and Quadratic Fluxes

A feedforward neural network framework for approximating the solutions to nonlinear ordinary differential equations

A conservative hybrid deep learning method for Maxwell–Ampère–Nernst–Planck equations

Subspace method based on neural networks for solving the partial differential equation

An End-to-End Deep Learning Method for Solving Nonlocal Allen-Cahn and Cahn-Hilliard Phase-Field Models

Design of Finite Difference Method and Neural Network Approach for Casson Nanofluid Flow: A Computational Study

Hybrid numerical method for the Allen–Cahn equation on nonuniform grids

HNS: An efficient hermite neural solver for solving time-fractional partial differential equations

Convergence analysis of exponential time differencing scheme for the nonlocal Cahn-Hilliard equation

A conservative hybrid physics-informed neural network method for Maxwell-Ampère-Nernst-Planck equations

Solving a Class of High-Order Elliptic PDEs Using Deep Neural Networks Based on Its Coupled Scheme

Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networks