Abstract:To quantify uncertainties in inverse problems of partial differential equations (PDEs), we formulate them into statistical inference problems using Bayes' formula. Recently, well-justified infinite-dimensional Bayesian analysis methods have been developed to construct dimension-independent algorithms. However, there are three challenges for these infinite-dimensional Bayesian methods: prior measures usually act as regularizers and are not able to incorporate prior information efficiently; complex noises, such as more practical non-i.i.d. distributed noises, are rarely considered; and time-consuming forward PDE solvers are needed to estimate posterior statistical quantities. To address these issues, an infinite-dimensional inference framework has been proposed based on the infinite-dimensional variational inference method and deep generative models. Specifically, by introducing some measure equivalence assumptions, we derive the evidence lower bound in the infinite-dimensional setting and provide possible parametric strategies that yield a general inference framework called the Variational Inverting Network (VINet). This inference framework can encode prior and noise information from learning examples. In addition, relying on the power of deep neural networks, the posterior mean and variance can be efficiently and explicitly generated in the inference stage. In numerical experiments, we design specific network structures that yield a computable VINet from the general inference framework. Numerical examples of linear inverse problems of an elliptic equation and the Helmholtz equation are presented to illustrate the effectiveness of the proposed inference framework.

A Measure-Theoretic Variational Bayesian Algorithm for Large Dimensional Problems

A Hierarchical Variational Bayesian Approximation Approach in Acoustic Imaging

A variational inference framework for inverse problems

VARIATIONAL BAYES' METHOD FOR FUNCTIONS WITH APPLICATIONS TO SOME INVERSE PROBLEMS

Variational Bayesian inference with stochastic search

A variational Bayes approach to debiased inference for low-dimensional parameters in high-dimensional linear regression

A variational Bayes framework for sparse adaptive estimation

Efficient Variational Bayesian Model Updating by Bayesian Active Learning

Adaptive variational Bayes: Optimality, computation and applications

Variational inference for large-scale models of discrete choice

Variational Gaussian Processes For Linear Inverse Problems

Variational Inference for Large Bayesian Vector Autoregressions

Variational Inference: A Review for Statisticians

$α$-Variational Inference with Statistical Guarantees

Auto-Encoding Variational Bayes

Distributed Variational Bayesian Algorithms Over Sensor Networks

On the Convergence of Coordinate Ascent Variational Inference

A New Variational Radial Basis Function Approximation for Inference in Multivariate Diffusions

Variational Bayesian Inference in High-Dimensional Linear Mixed Models

Consistency of variational Bayesian inference for non-linear inverse problems of partial differential equations

Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations