Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

Multilayered neural network for power series‐based approximation of fractional delay differential equations

Artificial neural network for solving the nonlinear singular fractional differential equations

A neural networks-based numerical method for the generalized Caputo-type fractional differential equations

An Artificial Neural Network Approach for Solving Space Fractional Differential Equations

deepFDEnet: A Novel Neural Network Architecture for Solving Fractional Differential Equations

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Solving Fractional Order Differential Equations by Using Fractional Radial Basis Function Neural Network

Application of Intelligent Paradigm through Neural Networks for Numerical Solution of Multiorder Fractional Differential Equations

Fibonacci Neural Network Approach for Numerical Solutions of Fractional Order Differential Equations

PMNN:Physical Model-driven Neural Network for solving time-fractional differential equations

Asymptotic stability of nonlinear fractional delay differential equations with α ∈ (1, 2): An application to fractional delay neural networks

Neural network method: delay and system of delay differential equations

Neural Fractional Differential Equations

A novel lagrange functional link neural network for solving variable-order fractional time-varying delay differential equations: a comparison with multilayer perceptron neural networks

Higher order numerical methods for fractional delay differential equations

A novel numerical approach for time-varying impulsive fractional differential equations using theory of functional connections and neural network

Adaptive Learning Neural Network Method for Solving Time–Fractional Diffusion Equations

Uniform Euler approximation of solutions of fractional-order delayed cellular neural network on bounded intervals

A new modern scheme for solving fractal-fractional differential equations based on deep feedforward neural network with multiple hidden layer

A new iterative technique for solving fractal-fractional differential equations based on artificial neural network in the new generalized Caputo sense

An application of artificial neural networks for solving fractional higher-order linear integro-differential equations