Abstract:Neural operators as novel neural architectures for fast approximating solution operators of partial differential equations (PDEs), have shown considerable promise for future scientific computing. However, the mainstream of training neural operators is still data-driven, which needs an expensive ground-truth dataset from various sources (e.g., solving PDEs' samples with the conventional solvers, real-world experiments) in addition to training stage costs. From a computational perspective, marrying operator learning and specific domain knowledge to solve PDEs is an essential step for data-efficient and low-carbon learning. We propose a novel data-efficient paradigm that provides a unified framework of training neural operators and solving PDEs with the domain knowledge related to the variational form, which we refer to as the variational operator learning (VOL). We develop Ritz and Galerkin approach respectively with finite element discretization for VOL to achieve matrix-free approximation of the energy functional of physical systems and calculation of residual tensors derived from associated linear systems with linear time complexity and O(1) space complexity. We then propose direct minimization and iterative update as two possible optimization strategies. Various types of experiments based on reasonable benchmarks about variable heat source, Darcy flow, and variable stiffness elasticity are conducted to demonstrate the effectiveness of VOL. With a label-free training set, VOL learns solution operators with its test errors decreasing in a power law with respect to the amount of unlabeled data. To the best of the authors' knowledge, this is the first study that integrates the perspectives of the weak form and efficient iterative methods for solving sparse linear systems into the end-to-end operator learning task. Codes and Datasets are publicly available at https://doi.org/10.5281/zenodo.11097870 .

Variational Physics-informed Neural Operator (VINO) for Solving Partial Differential Equations

Physics-Informed Neural Operator for Learning Partial Differential Equations

Variational Physics-Informed Neural Networks For Solving Partial Differential Equations

Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problems

Variational operator learning: A unified paradigm for training neural operators and solving partial differential equations

Learning Only on Boundaries: A Physics-Informed Neural Operator for Solving Parametric Partial Differential Equations in Complex Geometries

Physics-informed Discretization-independent Deep Compositional Operator Network

Neural Operator: Is data all you need to model the world? An insight into the impact of Physics Informed Machine Learning

Robust Variational Physics-Informed Neural Networks

Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods

Cv-Pinn: Efficient Learning of Variational Physics-Informed Neural Network with Domain Decomposition

Operator Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations Characterized by Sharp Solutions

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

Learning Partial Differential Equations with Deep Parallel Neural Operator

Solving forward and inverse PDE problems on unknown manifolds via physics-informed neural operators

A novel discretized physics-informed neural network model applied to the Navier-Stokes equations

Physics-informed variational inference for uncertainty quantification of stochastic differential equations