Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

Neural network and numerical methods performance comparison for prey-predator model

Numerical Simulation for the Treatment of Nonlinear Predator–Prey Equations by Using the Finite Element Optimization Method

A new numerical approach method to solve the Lotka–Volterra predator–prey models with discrete delays

Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networks

Solving Partial Differential Equations Using Artificial Neural Networks

Scientific machine learning in ecological systems: A study on the predator-prey dynamics

Can Physics-Informed Neural Networks beat the Finite Element Method?

Discovering Physics-Informed Neural Networks Model for Solving Partial Differential Equations through Evolutionary Computation

Data simulation of optimal model for numerical solution of differential equations based on deep learning and genetic algorithm

The advance of neural ordinary differential ordinary differential equations

Finite Difference Neural Networks: Fast Prediction of Partial Differential Equations

The Neural Network Approach to Inverse Problems in Differential Equations

Gudermannian neural network procedure for the nonlinear prey-predator dynamical system

Dynamic Analysis of a Predator and Prey Model with Some Computational Simulations

Solving an Infectious Disease Model considering Its Anatomical Variables with Stochastic Numerical Procedures

Nonstandard finite difference methods for a convective predator-prey pursuit and evasion model

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

Accuracy and Architecture Studies of Residual Neural Network solving Ordinary Differential Equations

Dynamics of a delayed discrete-time predator prey model proposed from a nonstandard finite difference scheme

From Mesh to Neural Nets: A Multi-Method Evaluation of Physics-Informed Neural Networks and Galerkin Finite Element Method for Solving Nonlinear Convection-Reaction-Diffusion Equations