Abstract:To quantify uncertainties in inverse problems of partial differential equations (PDEs), we formulate them into statistical inference problems using Bayes' formula. Recently, well-justified infinite-dimensional Bayesian analysis methods have been developed to construct dimension-independent algorithms. However, there are three challenges for these infinite-dimensional Bayesian methods: prior measures usually act as regularizers and are not able to incorporate prior information efficiently; complex noises, such as more practical non-i.i.d. distributed noises, are rarely considered; and time-consuming forward PDE solvers are needed to estimate posterior statistical quantities. To address these issues, an infinite-dimensional inference framework has been proposed based on the infinite-dimensional variational inference method and deep generative models. Specifically, by introducing some measure equivalence assumptions, we derive the evidence lower bound in the infinite-dimensional setting and provide possible parametric strategies that yield a general inference framework called the Variational Inverting Network (VINet). This inference framework can encode prior and noise information from learning examples. In addition, relying on the power of deep neural networks, the posterior mean and variance can be efficiently and explicitly generated in the inference stage. In numerical experiments, we design specific network structures that yield a computable VINet from the general inference framework. Numerical examples of linear inverse problems of an elliptic equation and the Helmholtz equation are presented to illustrate the effectiveness of the proposed inference framework.

Stein Variational Gradient Descent on Infinite-Dimensional Space and Applications to Statistical Inverse Problems

Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm

Stein Variational Gradient Descent with Local Approximations

Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference

Riemannian Stein Variational Gradient Descent for Bayesian Inference.

Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

Gradient-free Stein Variational Gradient Descent with Kernel Approximation

On the mean-field limit for Stein variational gradient descent: stability and multilevel approximation

Stein Variational Gradient Descent with Learned Direction

The Stein-log-Sobolev inequality and the exponential rate of convergence for the continuous Stein variational gradient descent method

VARIATIONAL BAYES' METHOD FOR FUNCTIONS WITH APPLICATIONS TO SOME INVERSE PROBLEMS

VI-DGP: A Variational Inference Method with Deep Generative Prior for Solving High-Dimensional Inverse Problems

Stochastic Gradient Descent for Linear Inverse Problems in Hilbert Spaces.

A Stein Gradient Descent Approach for Doubly Intractable Distributions

Augmented Message Passing Stein Variational Gradient Descent

Stochastic Inverse Problem: stability, regularization and Wasserstein gradient flow

Stein Variational Gaussian Processes

Stein Variational Evolution Strategies

Stochastic variance reduced gradient method for linear ill-posed inverse problems

Stein Variational Inference for Discrete Distributions

A Projection-Based Algorithm for Solving Stochastic Inverse Variational Inequality Problems