Abstract:Approximating solutions of ordinary and partial differential equations constitutes a significant challenge. Based on functional expressions that inherently depend on neural networks, neural forms are specifically designed to precisely satisfy the prescribed initial or boundary conditions of the problem, while providing the approximate solutions in closed form. Departing from the important class of ordinary differential equations, the present work aims to refine and validate the neural forms methodology, paving the ground for further developments in more challenging fields. The main contributions are as follows. First, it introduces a formalism for systematically crafting proper neural forms with adaptable boundary matches that are amenable to optimization. Second, it describes a novel technique for converting problems with Neumann or Robin conditions into equivalent problems with parametric Dirichlet conditions. Third, it outlines a method for determining an upper bound on the absolute deviation from the exact solution. The proposed augmented neural forms approach was tested on a set of diverse problems, encompassing first- and second-order ordinary differential equations, as well as first-order systems. Stiff differential equations have been considered as well. The resulting solutions were subjected to assessment against existing exact solutions, solutions derived through the common penalized neural method, and solutions obtained via contemporary numerical analysis methods. The reported results demonstrate that the augmented neural forms not only satisfy the boundary and initial conditions exactly, but also provide closed-form solutions that facilitate high-quality interpolation and controllable overall precision. These attributes are essential for expanding the application field of neural forms to more challenging problems that are described by partial differential equations.

Neural network augmented inverse problems for PDEs

The Neural Network Approach to Inverse Problems in Differential Equations

Inversion of Integral Models: a Neural Network Approach

A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks

Solving inverse-PDE problems with physics-aware neural networks

Deep neural networks can stably solve high-dimensional, noisy, non-linear inverse problems

Quadratic Neural Networks for Solving Inverse Problems

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

Inverse Physics-Informed Neural Networks for transport models in porous materials

Regularization of Inverse Problems by Neural Networks

Some elliptic second order problems and neural network solutions: Existence and error estimates

Solving the inverse potential problem in the parabolic equation by the deep neural networks method

Augmented neural forms with parametric boundary-matching operators for solving ordinary differential equations

Pseudo-differential integral autoencoder network for inverse PDE operators

A Combination of Deep Neural Networks and Physics to Solve the Inverse Problem of Burger's Equation

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

Solving inverse problems using conditional invertible neural networks

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEs

Solving ill-posed inverse problems using iterative deep neural networks