Abstract:Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important impact on learning and predicting the response of a complex physical system directly from observational data. Taking the material modeling problems for example, the neural operator approach learns a surrogate mapping from the loading field to the corresponding material response field, which can be seen as learning the solution operator of a hidden PDE. The microstructure and mechanical parameters of each material specimen correspond to the (possibly heterogeneous) parameter field in this hidden PDE. Due to the limitation on experimental measurement techniques, the data acquisition for each material specimen is commonly challenging and costly. This fact calls for the utilization and transfer of existing knowledge to new and unseen material specimens, which corresponds to sampling efficient learning of the solution operator of a hidden PDE with a different parameter field. Herein, we propose a novel meta-learning approach for neural operators, which can be seen as transferring the knowledge of solution operators between governing (unknown) PDEs with varying parameter fields. Our approach is a provably universal solution operator for multiple PDE solving tasks, with a key theoretical observation that underlying parameter fields can be captured in the first layer of neural operator models, in contrast to typical final-layer transfer in existing meta-learning methods. As applications, we demonstrate the efficacy of our proposed approach on PDE-based datasets and a real-world material modeling problem, illustrating that our method can handle complex and nonlinear physical response learning tasks while greatly improving the sampling efficiency in unseen tasks.

Meta-learning pseudo-differential operators with deep neural networks

Meta-learning Loss Functions of Parametric Partial Differential Equations Using Physics-Informed Neural Networks

MetaNO: How to Transfer Your Knowledge on Learning Hidden Physics

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations

Neural Green's Operators for Parametric Partial Differential Equations

Variational operator learning: A unified paradigm for training neural operators and solving partial differential equations

Learning Partial Differential Equations with Deep Parallel Neural Operator

Coupled Multiwavelet Neural Operator Learning for Coupled Partial Differential Equations

A new approach to neural networks using pseudo-differential operators

Deep Learning Solution of the Eigenvalue Problem for Differential Operators

Deep neural network for solving differential equations motivated by Legendre-Galerkin approximation

Finite Operator Learning: Bridging Neural Operators and Numerical Methods for Efficient Parametric Solution and Optimization of PDEs

Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data

Optimal deep learning of holomorphic operators between Banach spaces

Wavelet Neural Operator for solving parametric partial differential equations in computational mechanics problems

Meta-PDE: Learning to Solve PDEs Quickly Without a Mesh

Learning Green's functions associated with time-dependent partial differential equations

Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations

An Overview on Machine Learning Methods for Partial Differential Equations: from Physics Informed Neural Networks to Deep Operator Learning

Wavelet neural operator: a neural operator for parametric partial differential equations

Deep-learning of parametric partial differential equations from sparse and noisy data