Abstract:By now Bayesian methods are routinely used in practice for solving inverse problems. In inverse problems the parameter or signal of interest is observed only indirectly, as an image of a given map, and the observations are typically further corrupted with noise. Bayes offers a natural way to regularize these problems via the prior distribution and provides a probabilistic solution, quantifying the remaining uncertainty in the problem. However, the computational costs of standard, sampling based Bayesian approaches can be overly large in such complex models. Therefore, in practice variational Bayes is becoming increasingly popular. Nevertheless, the theoretical understanding of these methods is still relatively limited, especially in context of inverse problems. In our analysis we investigate variational Bayesian methods for Gaussian process priors to solve linear inverse problems. We consider both mildly and severely ill-posed inverse problems and work with the popular inducing variables variational Bayes approach proposed by Titsias in 2009. We derive posterior contraction rates for the variational posterior in general settings and show that the minimax estimation rate can be attained by correctly tunned procedures. As specific examples we consider a collection of inverse problems including the heat equation, Volterra operator and Radon transform and inducing variable methods based on population and empirical spectral features.

On some information-theoretic aspects of non-linear statistical inverse problems

Statistical guarantees for Bayesian uncertainty quantification in non-linear inverse problems with Gaussian process priors

Semi-parametric Bernstein-von Mises in Linear Inverse Problems

Bernstein - von Mises theorems for statistical inverse problems I: Schrödinger equation

Optimal low-rank approximations of posteriors for linear Gaussian inverse problems on Hilbert spaces

On log-concave approximations of high-dimensional posterior measures and stability properties in non-linear inverse problems

Consistency of variational Bayesian inference for non-linear inverse problems of partial differential equations

On the Frequentist Coverage of Bayes Posteriors in Nonlinear Inverse Problems

Linear methods for non-linear inverse problems

A Bayesian approach with Gaussian priors to the inverse problem of source identification in elliptic PDEs

Sensitivity Analysis of the Information Gain in Infinite-Dimensional Bayesian Linear Inverse Problems

Consistency of Bayesian inference with Gaussian process priors in an elliptic inverse problem

On the Bernstein-Von Mises Theorem for High Dimensional Nonlinear Bayesian Inverse Problems

Variational Gaussian Processes For Linear Inverse Problems

Bernstein -- von Mises theorems for statistical inverse problems II: Compound Poisson processes

Filter Based Methods for Statistical Linear Inverse Problems

Statistical inverse learning problems with random observations

Non-asymptotic error estimates for the Laplace approximation in Bayesian inverse problems

Learning linear operators: Infinite-dimensional regression as a well-behaved non-compact inverse problem

A posterior contraction for Bayesian inverse problems in Banach spaces

Infinite-dimensional Hamilton-Jacobi equations for statistical inference on sparse graphs