Abstract:Machine learning based solvers have garnered much attention in physical simulation and scientific computing, with a prominent example, physics-informed neural networks (PINNs). However, PINNs often struggle to solve high-frequency and multi-scale PDEs, which can be due to spectral bias during neural network training. To address this problem, we resort to the Gaussian process (GP) framework. To flexibly capture the dominant frequencies, we model the power spectrum of the PDE solution with a student $t$ mixture or Gaussian mixture. We apply the inverse Fourier transform to obtain the covariance function (by Wiener-Khinchin theorem). The covariance derived from the Gaussian mixture spectrum corresponds to the known spectral mixture kernel. Next, we estimate the mixture weights in the log domain, which we show is equivalent to placing a Jeffreys prior. It automatically induces sparsity, prunes excessive frequencies, and adjusts the remaining toward the ground truth. Third, to enable efficient and scalable computation on massive collocation points, which are critical to capture high frequencies, we place the collocation points on a grid, and multiply our covariance function at each input dimension. We use the GP conditional mean to predict the solution and its derivatives so as to fit the boundary condition and the equation itself. As a result, we can derive a Kronecker product structure in the covariance matrix. We use Kronecker product properties and multilinear algebra to promote computational efficiency and scalability, without low-rank approximations. We show the advantage of our method in systematic experiments. The code is released at \url{<a class="link-external link-https" href="https://github.com/xuangu-fang/Gaussian-Process-Slover-for-High-Freq-PDE" rel="external noopener nofollow">this https URL</a>}.

Accurately Solving the Poisson Equation by Combining Multiscale Radial Basis Functions and Gaussian Quadrature

Modified Nodal Cubic Spline Collocation For Poisson's Equation

An Improved Quadrature Scheme in B-spline Material Point Method for Large-Deformation Problem Analysis

A High Accuracy Muitigrid Method for the Three-Dimensional Poisson Equation

A New Pseudo-Spectral Method for Solving Poisson Equation in Polar Coordinate System

High order solution of Poisson problems with piecewise constant coefficients and interface jumps

A Non-Nested Multilevel Method for Meshless Solution of the Poisson Equation in Heat Transfer and Fluid Flow

The Method of Polynomial Particular Solutions for Solving Nonlinear Poisson-Type Equations

Solving Poisson Equation With Semi-Analytical Meshless Method

Collocation methods for integral fractional Laplacian and fractional PDEs based on radial basis functions

A locally second order symmetric method for discontinuous solution of Poisson's equation on uniform cartesian grids

A Fourth-Order Accurate Finite-Volume Method with Structured Adaptive Mesh Refinement for Solving the Advection-Diffusion Equation

Isogeometric collocation with smooth mixed degree splines over planar multi-patch domains

A fourth-order, multigrid cut-cell method for solving Poisson's equation in three-dimensional irregular domains

Robust Methods for Multiscale Coarse Approximations of Diffusion Models in Perforated Domains

Solving High Frequency and Multi-Scale PDEs with Gaussian Processes

Stable and Accurate Least Squares Radial Basis Function Approximations on Bounded Domains

Monotonicity, bounds and extrapolation of Block-Gauss and Gauss-Radau quadrature for computing $B^T ϕ(A) B$

On solving elliptic boundary value problems using a meshless method with radial polynomials

Radial basis function collocation method for decoupled fractional Laplacian wave equations

A Quasi-Interpolation Method For Solving Stiff Ordinary Differential Equations