Abstract:Discovering hidden partial differential equations (PDEs) and operators from data is an important topic at the frontier between machine learning and numerical analysis. This doctoral thesis introduces theoretical results and deep learning algorithms to learn Green's functions associated with linear partial differential equations and rigorously justify PDE learning techniques. A theoretically rigorous algorithm is derived to obtain a learning rate, which characterizes the amount of training data needed to approximately learn Green's functions associated with elliptic PDEs. The construction connects the fields of PDE learning and numerical linear algebra by extending the randomized singular value decomposition to non-standard Gaussian vectors and Hilbert--Schmidt operators, and exploiting the low-rank hierarchical structure of Green's functions using hierarchical matrices. Rational neural networks (NNs) are introduced and consist of neural networks with trainable rational activation functions. The highly compositional structure of these networks, combined with rational approximation theory, implies that rational functions have higher approximation power than standard activation functions. In addition, rational NNs may have poles and take arbitrarily large values, which is ideal for approximating functions with singularities such as Green's functions. Finally, theoretical results on Green's functions and rational NNs are combined to design a human-understandable deep learning method for discovering Green's functions from data. This approach complements state-of-the-art PDE learning techniques, as a wide range of physics can be captured from the learned Green's functions such as dominant modes, symmetries, and singularity locations.

Multiscale Neural Networks for Approximating Green's Functions

Green Multigrid Network

Learning Green's functions associated with time-dependent partial differential equations

Numerical solutions of boundary problems in partial differential equations: A deep learning framework with Green's function

Learning Green's Function Efficiently Using Low-Rank Approximations

Deep Generalized Green's Functions

BI-GreenNet: Learning Green's functions by boundary integral network

Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solvers

Two-scale Neural Networks for Partial Differential Equations with Small Parameters

Solving multiscale elliptic problems by sparse radial basis function neural networks

Neural Green's Function Accelerated Iterative Methods for Solving Indefinite Boundary Value Problems

Multiscale and Nonlocal Learning for PDEs using Densely Connected RNNs

Learning to Optimize Multigrid PDE Solvers

Neural Green's Operators for Parametric Partial Differential Equations

A hybrid physics-informed neural network based multiscale solver as a partial differential equation constrained optimization problem

Multipole Graph Neural Operator for Parametric Partial Differential Equations

Approximation of Two-dimensional Numerical Green's Function Using Neural Network

Learning Domain-Independent Green's Function For Elliptic Partial Differential Equations

A fully differentiable GNN-based PDE Solver: With Applications to Poisson and Navier-Stokes Equations

A Neural Network Approach for Homogenization of Multiscale Problems

Data-driven discovery of Green's functions