Abstract:In this paper we establish a mathematical framework for a range of inverse problems for functions, given a finite set of noisy observations. The problems are hence underdetermined and are often ill-posed. We study these problems from the viewpoint of Bayesian statistics, with the resulting posterior probability measure being defined on a space of functions. We develop an abstract framework for such problems which facilitates application of an infinite-dimensional version of Bayes theorem, leads to a well-posedness result for the posterior measure (continuity in a suitable probability metric with respect to changes in data), and also leads to a theory for the existence of maximizing the posterior probability (MAP) estimators for such Bayesian inverse problems on function space. A central idea underlying these results is that continuity properties and bounds on the forward model guide the choice of the prior measure for the inverse problem, leading to the desired results on well-posedness and MAP estimators; the PDE analysis and probability theory required are thus clearly dileneated, allowing a straightforward derivation of results. We show that the abstract theory applies to some concrete applications of interest by studying problems arising from data assimilation in fluid mechanics. The objective is to make inference about the underlying velocity field, on the basis of either Eulerian or Lagrangian observations. We study problems without model error, in which case the inference is on the initial condition, and problems with model error in which case the inference is on the initial condition and on the driving noise process or, equivalently, on the entire time-dependent velocity field. In order to undertake a relatively uncluttered mathematical analysis we consider the two-dimensional Navier–Stokes equation on a torus. The case of Eulerian observations—direct observations of the velocity field itself—is then a model for weather forecasting. The case of Lagrangian observations—observations of passive tracers advected by the flow—is then a model for data arising in oceanography. The methodology which we describe herein may be applied to many other inverse problems in which it is of interest to find, given observations, an infinite-dimensional object, such as the initial condition for a PDE. A similar approach might be adopted, for example, to determine an appropriate mathematical setting for the inverse problem of determining an unknown tensor arising in a constitutive law for a PDE, given observations of the solution. The paper is structured so that the abstract theory can be read independently of the particular problems in fluid mechanics which are subsequently studied by application of the theory.

On the well-posedness of inverse problems under information field theory: application to model-form error detection

Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification

Bayesian Inference and Deep Learning for Inverse Problems

Physics-informed and graph neural networks for enhanced inverse analysis

On some information-theoretic aspects of non-linear statistical inverse problems

An information field theory approach to Bayesian state and parameter estimation in dynamical systems

Towards optimal sensor placement for inverse problems in spaces of measures

Electric Field Reconstruction with Information Field Theory

A computational framework for infinite-dimensional Bayesian inverse problems. Part I: The linearized case, with application to global seismic inversion

Generalized Bayes Approach to Inverse Problems with Model Misspecification

Choosing observation operators to mitigate model error in Bayesian inverse problems

The Bayesian Formulation of EIT: Analysis and Algorithms

Bayesian inverse problems for functions and applications to fluid mechanics

A New Bi‐fidelity Model Reduction Method for Bayesian Inverse Problems

Sensitivity Analysis of the Information Gain in Infinite-Dimensional Bayesian Linear Inverse Problems

Rank-one matrix estimation: analysis of algorithmic and information theoretic limits by the spatial coupling method

Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problems

Characterizing the impact of model error in hydrogeologic time series recovery inverse problems

Random forward models and log-likelihoods in Bayesian inverse problems

A variational inference framework for inverse problems