Abstract:In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that incorporates prior information which is then updated through Bayes' formula. However, finding a prior is difficult, as images often exhibit non-stationary effects and multi-scale behaviour. Thus, usual Gaussian process priors are not suitable. Deep Gaussian processes, on the other hand, encode non-stationary behaviour in a natural way through their hierarchical structure. To apply Bayes' formula, one commonly employs a Markov chain Monte Carlo (MCMC) method. In the case of deep Gaussian processes, sampling is especially challenging in high dimensions: the associated covariance matrices are large, dense, and changing from sample to sample. A popular strategy towards decreasing computational complexity is to view Gaussian processes as the solutions to a fractional stochastic partial differential equation (SPDE). In this work, we investigate efficient computational strategies to solve the fractional SPDEs occurring in deep Gaussian process sampling, as well as MCMC algorithms to sample from the posterior. Namely, we combine rational approximation and a determinant-free sampling approach to achieve sampling via the fractional SPDE. We test our techniques in standard Bayesian image reconstruction problems: upsampling, edge detection, and computed tomography. In these examples, we show that choosing a non-stationary prior such as the deep GP over a stationary GP can improve the reconstruction. Moreover, our approach enables us to compare results for a range of fractional and non-fractional regularity parameter values.

Fused $L_{1/2}$ prior for large scale linear inverse problem with Gibbs bouncy particle sampler

Horseshoe priors for edge-preserving linear Bayesian inversion

Continuous Gaussian mixture solution for linear Bayesian inversion with application to Laplace priors

A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems

Ensemble-based implicit sampling for Bayesian inverse problems with non-Gaussian priors

Solving linear Bayesian inverse problems using a fractional total variation-Gaussian (FTG) prior and transport map

Deep Gaussian Process Priors for Bayesian Image Reconstruction

Bayesian inversion with Student's t priors based on Gaussian scale mixtures

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

Iterative Construction of Gaussian Process Surrogate Models for Bayesian Inference

A Residual-Driven Adaptive Gaussian Mixture Approximation for Bayesian Inverse Problems

Prior-preconditioned conjugate gradient method for accelerated Gibbs sampling in "large $n$ & large $p$" Bayesian sparse regression

A Discrete Bouncy Particle Sampler

Adaptive Bayesian density estimation using Pitman-Yor or normalized inverse-Gaussian process kernel mixtures

Sparse bayesian inference with regularized gaussian distributions

Diffusion Posterior Sampling for General Noisy Inverse Problems

Generalized sparsity-promoting solvers for Bayesian inverse problems: Versatile sparsifying transforms and unknown noise variances

Stochastic Collocation Algorithms Using L(1)-Minimization for Bayesian Solution of Inverse Problems

Posterior sampling via Langevin dynamics based on generative priors

Sparsity promoting hybrid solvers for hierarchical Bayesian inverse problems