Abstract:Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important impact on learning and predicting the response of a complex physical system directly from observational data. Taking the material modeling problems for example, the neural operator approach learns a surrogate mapping from the loading field to the corresponding material response field, which can be seen as learning the solution operator of a hidden PDE. The microstructure and mechanical parameters of each material specimen correspond to the (possibly heterogeneous) parameter field in this hidden PDE. Due to the limitation on experimental measurement techniques, the data acquisition for each material specimen is commonly challenging and costly. This fact calls for the utilization and transfer of existing knowledge to new and unseen material specimens, which corresponds to sampling efficient learning of the solution operator of a hidden PDE with a different parameter field. Herein, we propose a novel meta-learning approach for neural operators, which can be seen as transferring the knowledge of solution operators between governing (unknown) PDEs with varying parameter fields. Our approach is a provably universal solution operator for multiple PDE solving tasks, with a key theoretical observation that underlying parameter fields can be captured in the first layer of neural operator models, in contrast to typical final-layer transfer in existing meta-learning methods. As applications, we demonstrate the efficacy of our proposed approach on PDE-based datasets and a real-world material modeling problem, illustrating that our method can handle complex and nonlinear physical response learning tasks while greatly improving the sampling efficiency in unseen tasks.

Meta-learning Loss Functions of Parametric Partial Differential Equations Using Physics-Informed Neural Networks

Meta-learning of Physics-informed Neural Networks for Efficiently Solving Newly Given PDEs

Optimally weighted loss functions for solving PDEs with Neural Networks

Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods

Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equations

Physics-Informed Neural Networks (PINNs) for Parameterized PDEs: A Metalearning Approach

A metalearning approach for Physics-Informed Neural Networks (PINNs): Application to parameterized PDEs

Learning from Integral Losses in Physics Informed Neural Networks

Meta-PDE: Learning to Solve PDEs Quickly Without a Mesh

Applying physics-based loss functions to neural networks for improved generalizability in mechanics problems

Critical Investigation of Failure Modes in Physics-informed Neural Networks

GPT-PINN: Generative Pre-Trained Physics-Informed Neural Networks toward non-intrusive Meta-learning of parametric PDEs

Multi-Objective Loss Balancing for Physics-Informed Deep Learning

An Overview on Machine Learning Methods for Partial Differential Equations: from Physics Informed Neural Networks to Deep Operator Learning

An extended physics informed neural network for preliminary analysis of parametric optimal control problems

Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networks

Deep-learning of parametric partial differential equations from sparse and noisy data

Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

Learning Partial Differential Equations from Data Using Neural Networks

MetaNO: How to Transfer Your Knowledge on Learning Hidden Physics