Abstract:We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators, which is to correct the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction--diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.

Inversion of Integral Models: a Neural Network Approach

Bayesian Inference and Deep Learning for Inverse Problems

Stability Bounds for the Unfolded Forward-Backward Algorithm

Deep neural networks can stably solve high-dimensional, noisy, non-linear inverse problems

The Neural Network Approach to Inverse Problems in Differential Equations

To be or not to be stable, that is the question: understanding neural networks for inverse problems

Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architectures

Invertible residual networks in the context of regularization theory for linear inverse problems

A Neural Network for Solving Inverse Quasi-Variational Inequalities

Regularization of Inverse Problems by Neural Networks

Convergence and Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems

Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

Neumann Networks for Inverse Problems in Imaging

Neural network augmented inverse problems for PDEs

A Novel Method to Solve Inverse Variational Inequality Problems Based on Neural Networks

Quadratic neural networks for solving inverse problems

Notes on a Neural Network Approach to Inverse Variational Inequalities

Learning truly monotone operators with applications to nonlinear inverse problems

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

Ambiguity in solving imaging inverse problems with deep learning based operators