Abstract:In this paper we establish a mathematical framework for a range of inverse problems for functions, given a finite set of noisy observations. The problems are hence underdetermined and are often ill-posed. We study these problems from the viewpoint of Bayesian statistics, with the resulting posterior probability measure being defined on a space of functions. We develop an abstract framework for such problems which facilitates application of an infinite-dimensional version of Bayes theorem, leads to a well-posedness result for the posterior measure (continuity in a suitable probability metric with respect to changes in data), and also leads to a theory for the existence of maximizing the posterior probability (MAP) estimators for such Bayesian inverse problems on function space. A central idea underlying these results is that continuity properties and bounds on the forward model guide the choice of the prior measure for the inverse problem, leading to the desired results on well-posedness and MAP estimators; the PDE analysis and probability theory required are thus clearly dileneated, allowing a straightforward derivation of results. We show that the abstract theory applies to some concrete applications of interest by studying problems arising from data assimilation in fluid mechanics. The objective is to make inference about the underlying velocity field, on the basis of either Eulerian or Lagrangian observations. We study problems without model error, in which case the inference is on the initial condition, and problems with model error in which case the inference is on the initial condition and on the driving noise process or, equivalently, on the entire time-dependent velocity field. In order to undertake a relatively uncluttered mathematical analysis we consider the two-dimensional Navier–Stokes equation on a torus. The case of Eulerian observations—direct observations of the velocity field itself—is then a model for weather forecasting. The case of Lagrangian observations—observations of passive tracers advected by the flow—is then a model for data arising in oceanography. The methodology which we describe herein may be applied to many other inverse problems in which it is of interest to find, given observations, an infinite-dimensional object, such as the initial condition for a PDE. A similar approach might be adopted, for example, to determine an appropriate mathematical setting for the inverse problem of determining an unknown tensor arising in a constitutive law for a PDE, given observations of the solution. The paper is structured so that the abstract theory can be read independently of the particular problems in fluid mechanics which are subsequently studied by application of the theory.

Linear methods for non-linear inverse problems

Bayesian Inference and Deep Learning for Inverse Problems

Semi-parametric Bernstein-von Mises in Linear Inverse Problems

Consistency of variational Bayesian inference for non-linear inverse problems of partial differential equations

A posterior contraction for Bayesian inverse problems in Banach spaces

Bayesian Approach To A Nonlinear Inverse Problem For A Time-Space Fractional Diffusion Equation

Bayesian Posterior Contraction Rates for Linear Severely Ill-posed Inverse Problems

Consistency of Bayesian inference with Gaussian process priors for a parabolic inverse problem

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

Towards a variational principle for motivated vehicle motion

Adaptive Bregman-Kaczmarz: An Approach to Solve Linear Inverse Problems with Independent Noise Exactly

Non-asymptotic error estimates for the Laplace approximation in Bayesian inverse problems

On the Frequentist Coverage of Bayes Posteriors in Nonlinear Inverse Problems

Bayesian inverse problems for functions and applications to fluid mechanics

Solving a nonlinear inverse Sturm-Liouville problem with nonlinear convective term using a boundary functional method

On the convergence of the Laplace approximation and noise-level-robustness of Laplace-based Monte Carlo methods for Bayesian inverse problems

A Regularizing Multilevel Approach for Nonlinear Inverse Problems

Adaptive operator learning for infinite-dimensional Bayesian inverse problems

Inverse Problems in a Bayesian Setting

Bernstein - von Mises theorems for statistical inverse problems I: Schrödinger equation

Choosing observation operators to mitigate model error in Bayesian inverse problems