Abstract:Machine learning has been successfully applied to various fields of scientific computing in recent years. In this work, we propose a sparse radial basis function neural network method to solve elliptic partial differential equations (PDEs) with multiscale coefficients. Inspired by the deep mixed residual method, we rewrite the second-order problem into a first-order system and employ multiple radial basis function neural networks (RBFNNs) to approximate unknown functions in the system. To aviod the overfitting due to the simplicity of RBFNN, an additional regularization is introduced in the loss function. Thus the loss function contains two parts: the $L_2$ loss for the residual of the first-order system and boundary conditions, and the $\ell_1$ regularization term for the weights of radial basis functions (RBFs). An algorithm for optimizing the specific loss function is introduced to accelerate the training process. The accuracy and effectiveness of the proposed method are demonstrated through a collection of multiscale problems with scale separation, discontinuity and multiple scales from one to three dimensions. Notably, the $\ell_1$ regularization can achieve the goal of representing the solution by fewer RBFs. As a consequence, the total number of RBFs scales like $\mathcal{O}(\varepsilon^{-n\tau})$, where $\varepsilon$ is the smallest scale, $n$ is the dimensionality, and $\tau$ is typically smaller than $1$. It is worth mentioning that the proposed method not only has the numerical convergence and thus provides a reliable numerical solution in three dimensions when a classical method is typically not affordable, but also outperforms most other available machine learning methods in terms of accuracy and robustness.

Solve Partial Differential Equations by Two or More Radial Basis Functions

A new type of radial basis functions for problems governed by partial differential equations

Some Problems with the Method of Fundamental Solution Using Radial Basis Functions

A Simultaneous Strategy Based on Radial Basis Function for Dynamic Optimization

A Novel Domain Decomposition Method for Highly Oscillating Partial Differential Equations

Solving Partial Differential Equations by Meshless Methods Using Radial Basis Functions

Numerical investigation of high-dimensional option pricing PDEs by utilizing a hybrid radial basis function - finite difference procedure

A novel local Hermite radial basis function‐based differential quadrature method for solving two‐dimensional variable‐order time fractional advection–diffusion equation with Neumann boundary conditions

Simulation of linear and nonlinear advection-diffusion problems by the direct radial basis function collocation method

A novel Hermite RBF-based differential quadrature method for solving two-dimensional variable-order time fractional advection-diffusion equation with Neumann boundary condition

High-order numerical method for solving elliptic partial differential equations on unfitted node sets

An Adaptive Orthogonal Basis Method for Computing Multiple Solutions of Differential Equations with Polynomial Nonlinearities

Solving multiscale elliptic problems by sparse radial basis function neural networks

A discrete least squares collocation method for two-dimensional nonlinear time-dependent partial differential equations

Reduced Krylov Basis Methods for Parametric Partial Differential Equations

An efficient radial basis function generated finite difference meshfree scheme to price multi-dimensional PDEs in financial options

Solve Partial Differential Equations by Meshless Subdomains Method Combined with RBFs

Improved Kansa RBF method for the solution of nonlinear boundary value problems

New RBF collocation methods and kernel RBF with applications

A RBF partition of unity collocation method based on finite difference for initial-boundary value problems