Abstract:We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the proposed approach has two stages: (1) prior learning and (2) posterior estimation. At the first stage, we employ the physics-informed Generative Adversarial Networks (PI-GAN) to learn a functional prior either from a prescribed function distribution, e.g., Gaussian process, or from historical data and physics. At the second stage, we employ the Hamiltonian Monte Carlo (HMC) method to estimate the posterior in the latent space of PI-GANs. In addition, we use two different approaches to encode the physics: (1) automatic differentiation, used in the physics-informed neural networks (PINNs) for scenarios with explicitly known partial differential equations (PDEs), and (2) operator regression using the deep operator network (DeepONet) for PDE-agnostic scenarios. We then test the proposed method for (1) meta-learning for one-dimensional regression, and forward/inverse PDE problems (combined with PINNs); (2) PDE-agnostic physical problems (combined with DeepONet), e.g., fractional diffusion as well as saturated stochastic (100-dimensional) flows in heterogeneous porous media; and (3) spatial-temporal regression problems, i.e., inference of a marine riser displacement field using experimental data from the Norwegian Deepwater Programme (NDP). The results demonstrate that the proposed approach can provide accurate predictions as well as uncertainty quantification given very limited scattered and noisy data, since historical data could be available to provide informative priors. In , the proposed method is capable of learning flexible functional priors, e.g., both Gaussian and non-Gaussian process, and can be readily extended to big data problems by enabling mini-batch training using stochastic HMC or normalizing flows since the latent space is generally characterized as low dimensional.

Proximal nested sampling with data-driven priors for physical scientists

Nested sampling for physical scientists

Fast Bayesian hierarchical inference via sparsity enforcing a priori for aeroacoustic source imaging

Phantom-Powered Nested Sampling

Nested Sampling Methods

Proximal MCMC for Bayesian Inference of Constrained and Regularized Estimation

Learning functional priors and posteriors from data and physics

A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications

NAUTILUS: boosting Bayesian importance nested sampling with deep learning

Bayesian Inference Using the Proximal Mapping: Uncertainty Quantification Under Varying Dimensionality

Deep Learning and genetic algorithms for cosmological Bayesian inference speed-up

Bayesian Nonparametrics: An Alternative to Deep Learning

Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problems

Proximal Langevin Sampling With Inexact Proximal Mapping

Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors

ProxNF: Neural Field Proximal Training for High-Resolution 4D Dynamic Image Reconstruction

Notes on the Practical Application of Nested Sampling: MultiNest, (Non)convergence, and Rectification

Efficient Bayesian Computation by Proximal Markov Chain Monte Carlo: When Langevin Meets Moreau

A Common Atom Model for the Bayesian Nonparametric Analysis of Nested Data

Semi-Supervised Non-Parametric Bayesian Modelling of Spatial Proteomics

Accelerated Bayesian Imaging by Relaxed Proximal-Point Langevin Sampling