Abstract:Approximating solutions of ordinary and partial differential equations constitutes a significant challenge. Based on functional expressions that inherently depend on neural networks, neural forms are specifically designed to precisely satisfy the prescribed initial or boundary conditions of the problem, while providing the approximate solutions in closed form. Departing from the important class of ordinary differential equations, the present work aims to refine and validate the neural forms methodology, paving the ground for further developments in more challenging fields. The main contributions are as follows. First, it introduces a formalism for systematically crafting proper neural forms with adaptable boundary matches that are amenable to optimization. Second, it describes a novel technique for converting problems with Neumann or Robin conditions into equivalent problems with parametric Dirichlet conditions. Third, it outlines a method for determining an upper bound on the absolute deviation from the exact solution. The proposed augmented neural forms approach was tested on a set of diverse problems, encompassing first- and second-order ordinary differential equations, as well as first-order systems. Stiff differential equations have been considered as well. The resulting solutions were subjected to assessment against existing exact solutions, solutions derived through the common penalized neural method, and solutions obtained via contemporary numerical analysis methods. The reported results demonstrate that the augmented neural forms not only satisfy the boundary and initial conditions exactly, but also provide closed-form solutions that facilitate high-quality interpolation and controllable overall precision. These attributes are essential for expanding the application field of neural forms to more challenging problems that are described by partial differential equations.

Legendre Neural Network Method for Several Classes of Singularly Perturbed Differential Equations Based on Mapping and Piecewise Optimization Technology

Application of multivariate bilinear neural network method to fractional partial differential equations

Deep neural network for solving differential equations motivated by Legendre-Galerkin approximation

Piecewise Neural Network Method for Solving Large Interval Solutions to Initial Value Problems of Ordinary Differential Equations

Subspace method based on neural networks for solving the partial differential equation

A New Neural Network Model And Its Application

On Solutions to Several Classes of Differential-Algebraic Equations Based on Artificial Neural Networks

A piecewise neural network method for solving large interval solution to initial value problem of ordinary differential equations

Jacobi Neural Network Method for Solving Linear Differential-Algebraic Equations with Variable Coefficients

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Application of neural network modeling methods in solving initial boundary value problems for partial differential equations

Numerical solution for initial and boundary value problems of high-order ordinary differential equations using Hermite neural network algorithm with improved extreme learning machine

Gauss Newton method for solving variational problems of PDEs with neural network discretizaitons

A neural networks-based numerical method for the generalized Caputo-type fractional differential equations

Semi-analytic PINN methods for singularly perturbed boundary value problems

Neural Network As a Function Approximator and Its Application in Solving Differential Equations

Approximate Optimal Control Design for Nonlinear One-Dimensional Parabolic PDE Systems Using Empirical Eigenfunctions and Neural Network

Neural Network for a Class of Sparse Optimization with L0-regularization.

Augmented neural forms with parametric boundary-matching operators for solving ordinary differential equations

Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations