Abstract:Bayesian inference provides a systematic framework for integration of data with mathematical models to quantify the uncertainty in the solution of the inverse problem. However, the solution of Bayesian inverse problems governed by complex forward models described by partial differential equations (PDEs) remains prohibitive with black-box Markov chain Monte Carlo (MCMC) methods. We present hIPPYlib-MUQ, an extensible and scalable software framework that contains implementations of state-of-the art algorithms aimed to overcome the challenges of high-dimensional, PDE-constrained Bayesian inverse problems. These algorithms accelerate MCMC sampling by exploiting the geometry and intrinsic low-dimensionality of parameter space via derivative information and low rank approximation. The software integrates two complementary open-source software packages, hIPPYlib and MUQ. hIPPYlib solves PDE-constrained inverse problems using automatically-generated adjoint-based derivatives, but it lacks full Bayesian capabilities. MUQ provides a spectrum of powerful Bayesian inversion models and algorithms, but expects forward models to come equipped with gradients and Hessians to permit large-scale solution. By combining these two complementary libraries, we created a robust, scalable, and efficient software framework that realizes the benefits of each and allows us to tackle complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering disciplines. To illustrate the capabilities of hIPPYlib-MUQ, we present a comparison of a number of MCMC methods available in the integrated software on several high-dimensional Bayesian inverse problems. These include problems characterized by both linear and nonlinear PDEs, various noise models, and different parameter dimensions. The results demonstrate that large (∼ 50 ×) speedups over conventional black box and gradient-based MCMC algorithms can be obtained by exploiting Hessian information (from the log-posterior), underscoring the power of the integrated hIPPYlib-MUQ framework.

A data-driven and model-based accelerated Hamiltonian Monte Carlo method for Bayesian elliptic inverse problems

A Meshless Method for Some Inverse Problems Associated with the Helmholtz Equation

Multi-fidelity Hamiltonian Monte Carlo

Optimization-Based MCMC Methods for Nonlinear Hierarchical Statistical Inverse Problems

Hamiltonian Monte Carlo Acceleration Using Surrogate Functions with Random Bases

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems

HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models

2D probabilistic inversion of MT data and uncertainty quantification using the Hamiltonian Monte Carlo method

hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty

HMCLab: a framework for solving diverse geophysical inverse problems using the Hamiltonian Monte Carlo method

An improved implicit sampling for Bayesian inverse problems of multi-term time fractional multiscale diffusion models

Adaptive operator learning for infinite-dimensional Bayesian inverse problems

Quasi-Monte Carlo for Bayesian design of experiment problems governed by parametric PDEs

Quasi-Newton Hamiltonian Monte Carlo.

Deep surrogate accelerated delayed-acceptance HMC for Bayesian inference of spatio-temporal heat fluxes in rotating disc systems

Generalized Bayes Approach to Inverse Problems with Model Misspecification

Multiscale model reduction method for Bayesian inverse problems of subsurface flow

Improvement of Bayesian PINN Training Convergence in Solving Multi-scale PDEs with Noise

Quasi-Monte Carlo and importance sampling methods for Bayesian inverse problems

ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equation