Abstract:In this paper we establish a mathematical framework for a range of inverse problems for functions, given a finite set of noisy observations. The problems are hence underdetermined and are often ill-posed. We study these problems from the viewpoint of Bayesian statistics, with the resulting posterior probability measure being defined on a space of functions. We develop an abstract framework for such problems which facilitates application of an infinite-dimensional version of Bayes theorem, leads to a well-posedness result for the posterior measure (continuity in a suitable probability metric with respect to changes in data), and also leads to a theory for the existence of maximizing the posterior probability (MAP) estimators for such Bayesian inverse problems on function space. A central idea underlying these results is that continuity properties and bounds on the forward model guide the choice of the prior measure for the inverse problem, leading to the desired results on well-posedness and MAP estimators; the PDE analysis and probability theory required are thus clearly dileneated, allowing a straightforward derivation of results. We show that the abstract theory applies to some concrete applications of interest by studying problems arising from data assimilation in fluid mechanics. The objective is to make inference about the underlying velocity field, on the basis of either Eulerian or Lagrangian observations. We study problems without model error, in which case the inference is on the initial condition, and problems with model error in which case the inference is on the initial condition and on the driving noise process or, equivalently, on the entire time-dependent velocity field. In order to undertake a relatively uncluttered mathematical analysis we consider the two-dimensional Navier–Stokes equation on a torus. The case of Eulerian observations—direct observations of the velocity field itself—is then a model for weather forecasting. The case of Lagrangian observations—observations of passive tracers advected by the flow—is then a model for data arising in oceanography. The methodology which we describe herein may be applied to many other inverse problems in which it is of interest to find, given observations, an infinite-dimensional object, such as the initial condition for a PDE. A similar approach might be adopted, for example, to determine an appropriate mathematical setting for the inverse problem of determining an unknown tensor arising in a constitutive law for a PDE, given observations of the solution. The paper is structured so that the abstract theory can be read independently of the particular problems in fluid mechanics which are subsequently studied by application of the theory.

VARIATIONAL BAYES' METHOD FOR FUNCTIONS WITH APPLICATIONS TO SOME INVERSE PROBLEMS

Bayesian Inference and Deep Learning for Inverse Problems

A Hierarchical Variational Bayesian Approximation Approach in Acoustic Imaging

A Variational Bayesian Approximation Approach Via A Sparsity Enforcing Prior In Acoustic Imaging

Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

Variational Gaussian Processes For Linear Inverse Problems

Bayesian Approach to Inverse Problems for Functions with A Variable-Index Besov Prior

A variational inference framework for inverse problems

Generalized Bayes Approach to Inverse Problems with Model Misspecification

Efficient Variational Bayesian Model Updating by Bayesian Active Learning

Non-centered Parametric Variational Bayes' Approach for Hierarchical Inverse Problems of Partial Differential Equations.

Consistency of variational Bayesian inference for non-linear inverse problems of partial differential equations

Stein Variational Gradient Descent on Infinite-Dimensional Space and Applications to Statistical Inverse Problems

A posterior contraction for Bayesian inverse problems in Banach spaces

Bayesian inverse problems for functions and applications to fluid mechanics

Bayesian Inversion, Uncertainty Analysis and Interrogation Using Boosting Variational Inference

A Measure-Theoretic Variational Bayesian Algorithm for Large Dimensional Problems

VI-DGP: A Variational Inference Method with Deep Generative Prior for Solving High-Dimensional Inverse Problems

Score-Based Variational Inference for Inverse Problems

A variational Bayesian method for inverse problems with impulsive noise

Learning to solve Bayesian inverse problems: An amortized variational inference approach using Gaussian and Flow guides