Abstract:This paper presents a deep learning feedforward neural network framework as a numerical tool to approximate the solutions to singular nonlinear ordinary differential equations arising in physiology. Artificial neural network (ANN) models are best suited for optimization problems. By casting the solution finding algorithm into a weighted-residual type minimization procedure, the ANN models are shown to be capable of approximating the solution to varieties of equations: ordinary differential equations, partial differential equations and integral equations. In this paper, we utilize a mean-square type loss function in an unsupervised learning network—without actually requiring exact or approximate solution for training—to find the approximate solution to varieties singular differential equations. The total loss function includes the strong form differential equation along with initial/boundary condition terms. During the training phase, our network is trained using a linear interpolation of the small data set, then it adjusts itself to approximate the curvature so that the total loss value is small. The fine-tuning of network’s hyperparameters, which are the weights and bias, is done through the backpropogation step. The efficiency of the proposed method is demonstrated by approximating the solutions to several singular differential equations. We report that the relative error in all the problems are of the order of 10-4$$10^{-4}$$ to 10-7$$10^{-7}$$. The entire computational framework is developed using Python programming platform along with Tensorflow and Keras libraries. Our study has several advantages: first, the entire neural network architecture is easy to implement; second, there is no need for exact solution during the training phase; third, only few data points and a linear interpolation are needed for training and then the network adjusts itself to match the curvature. Furthermore, our study presents a comprehensive comparative examination to settle several issues regarding the choice of various parameters in the network.

LS-SVM based solutions to differential equations

Learning solutions to partial differential equations using LS-SVM

Using Svm To Model And Control Nonlinear Dynamical Systems

Analytically Embedding Differential Equation Constraints into Least Squares Support Vector Machines using the Theory of Functional Connections

An Orthogonal Polynomial Kernel-Based Machine Learning Model for Differential-Algebraic Equations

Dynamic least squares support vector machine

Solving higher order nonlinear ordinary differential equations with least squares support vector machines

A novel approach for solving linear Fredholm integro-differential equations via LS-SVM algorithm

Numerical solutions to one dimensional linear Volterra-Fredholm integral equations based on LS-SVM model

Kernel Ordinary Differential Equations

Learning To Solve Differential Equation Constrained Optimization Problems

Learning Differential Equations that are Easy to Solve

Extreme Learning Machine with Kernels for Solving Elliptic Partial Differential Equations

Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations

Error modeling for surrogates of dynamical systems using machine learning

Learning Governing Equations of Unobserved States in Dynamical Systems

Parameter Estimation and Variable Selection for Big Systems of Linear Ordinary Differential Equations: A Matrix-Based Approach

A Deep Learning Neural Network Framework for Solving Singular Nonlinear Ordinary Differential Equations

An approximate operator-based learning method for the numerical solutions of stochastic differential equations

Variational formulation based on duality to solve partial differential equations: Use of B-splines and machine learning approximants

Machine Learning Methods for Autonomous Ordinary Differential Equations