Abstract:In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered considerable interest due to their flexibility, robust theoretical guarantees, and close ties to traditional methods. They can transform the solving of general nonlinear PDEs into solving quadratic optimization problems with nonlinear, PDE-induced constraints. However, the complexity bottleneck lies in computing with dense kernel matrices obtained from pointwise evaluations of the covariance kernel, and its partial derivatives, a result of the PDE constraint and for which fast algorithms are scarce. The primary goal of this paper is to provide a near-linear complexity algorithm for working with such kernel matrices. We present a sparse Cholesky factorization algorithm for these matrices based on the near-sparsity of the Cholesky factor under a novel ordering of pointwise and derivative measurements. The near-sparsity is rigorously justified by directly connecting the factor to GP regression and exponential decay of basis functions in numerical homogenization. We then employ the Vecchia approximation of GPs, which is optimal in the Kullback-Leibler divergence, to compute the approximate factor. This enables us to compute ε \epsilon -approximate inverse Cholesky factors of the kernel matrices with complexity O ( N log d ⁡ ( N / ε ) ) O(N\log ^d(N/\epsilon )) in space and O ( N log 2 d ⁡ ( N / ε ) ) O(N\log ^{2d}(N/\epsilon )) in time. We integrate sparse Cholesky factorizations into optimization algorithms to obtain fast solvers of the nonlinear PDE. We numerically illustrate our algorithm's near-linear space/time complexity for a broad class of nonlinear PDEs such as the nonlinear elliptic, Burgers, and Monge-Ampère equations. In summary, we provide a fast, scalable, and accurate method for solving general PDEs with GPs and kernel methods.

A gaussian process framework for solving forward and inverse problems involving nonlinear partial differential equations

A Gaussian Process Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations

Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems

Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solvers

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

Solving High Frequency and Multi-Scale PDEs with Gaussian Processes

Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations

Fully probabilistic deep models for forward and inverse problems in parametric PDEs

Towards Gaussian Process for operator learning: an uncertainty aware resolution independent operator learning algorithm for computational mechanics

A fully differentiable GNN-based PDE Solver: With Applications to Poisson and Navier-Stokes Equations

Recipes for when physics fails: recovering robust learning of physics informed neural networks

A Mini-Batch Method for Solving Nonlinear PDEs with Gaussian Processes

Physics-informed kernel learning

Neural Operator induced Gaussian Process framework for probabilistic solution of parametric partial differential equations

Physics Inspired Approaches To Understanding Gaussian Processes

Physics Informed Neural Networks for an Inverse Problem in Peridynamic Models

Sparse Cholesky factorization for solving nonlinear PDEs via Gaussian processes

Physics-informed machine learning for moving load problems

Combining physics-informed graph neural network and finite difference for solving forward and inverse spatiotemporal PDEs

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges