Abstract:We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the extreme learning machine (ELM) approach from low to high dimensions. With the first method the unknown solution field in $d$ dimensions is represented by a randomized feed-forward neural network, in which the hidden-layer parameters are randomly assigned and fixed while the output-layer parameters are trained. The PDE and the boundary/initial conditions, as well as the continuity conditions (for the local variant of the method), are enforced on a set of random interior/boundary collocation points. The resultant linear or nonlinear algebraic system, through its least squares solution, provides the trained values for the network parameters. With the second method the high-dimensional PDE problem is reformulated through a constrained expression based on an Approximate variant of the Theory of Functional Connections (A-TFC), which avoids the exponential growth in the number of terms of TFC as the dimension increases. The free field function in the A-TFC constrained expression is represented by a randomized neural network and is trained by a procedure analogous to the first method. We present ample numerical simulations for a number of high-dimensional linear/nonlinear stationary/dynamic PDEs to demonstrate their performance. These methods can produce accurate solutions to high-dimensional PDEs, in particular with their errors reaching levels not far from the machine accuracy for relatively lower dimensions. Compared with the physics-informed neural network (PINN) method, the current method is both cost-effective and more accurate for high-dimensional PDEs.

Some observations on high-dimensional partial differential equations with Barron data

Some observations on partial differential equations in Barron and multi-layer spaces

Representation Formulas and Pointwise Properties for Barron Functions

The Barron Space and the Flow-Induced Function Spaces for Neural Network Models

Solving parametric PDE problems with artificial neural networks

Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures

Embedding Inequalities for Barron-type Spaces

Embeddings between Barron spaces with higher order activation functions

Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory

A Priori Estimation of the Approximation, Optimization and Generalization Errors of Random Neural Networks for Solving Partial Differential Equations

Solving High-Dimensional Partial Differential Equations Using Deep Learning.

An Extreme Learning Machine-Based Method for Computational PDEs in Higher Dimensions

Anti-symmetric Barron functions and their approximation with sums of determinants

Learning Partial Differential Equations from Data Using Neural Networks

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

A Duality Framework for Generalization Analysis of Random Feature Models and Two-Layer Neural Networks.

Solving Partial Differential Equations Using Point-Based Neural Networks.

High-dimensional classification problems with Barron regular boundaries under margin conditions

Barron Space for Graph Convolution Neural Networks

Solving partial differential equations with sampled neural networks

Solving High Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators