Abstract:We propose a physics-informed machine learning method for uncertainty quantification in high-dimensional inverse problems. In this method, the states and parameters of partial differential equations (PDEs) are approximated with truncated conditional Karhunen-Loève expansions (CKLEs), which, by construction, match the measurements of the respective variables. The maximum a posteriori (MAP) solution of the inverse problem is formulated as a minimization problem over CKLE coefficients where the loss function is the sum of the norm of PDE residuals and the $\ell_2$ regularization term. This MAP formulation is known as the physics-informed CKLE (PICKLE) method. Uncertainty in the inverse solution is quantified in terms of the posterior distribution of CKLE coefficients, and we sample the posterior by solving a randomized PICKLE minimization problem, formulated by adding zero-mean Gaussian perturbations in the PICKLE loss function. We call the proposed approach the randomized PICKLE (rPICKLE) method. For linear and low-dimensional nonlinear problems (15 CKLE parameters), we show analytically and through comparison with Hamiltonian Monte Carlo (HMC) that the rPICKLE posterior converges to the true posterior given by the Bayes rule. For high-dimensional non-linear problems with 2000 CKLE parameters, we numerically demonstrate that rPICKLE posteriors are highly informative--they provide mean estimates with an accuracy comparable to the estimates given by the MAP solution and the confidence interval that mostly covers the reference solution. We are not able to obtain the HMC posterior to validate rPICKLE's convergence to the true posterior due to the HMC's prohibitive computational cost for the considered high-dimensional problems. Our results demonstrate the advantages of rPICKLE over HMC for approximately sampling high-dimensional posterior distributions subject to physics constraints.

Enhanced Feynman-Kac Formula for Nonlinear Uncertainty Quantification Problems

A Generalized Multi-Fidelity Simulation Method Using Sparse Polynomial Chaos Expansion

Feynman-Kac Formula for Nonlinear Schrödinger Equations with Applications in Numerical Approximations

Uncertainty Quantification in Neural Differential Equations

Feynman-Kac representation of fully nonlinear PDEs and applications

Nonlinear Expectation Inference for Direct Uncertainty Quantification of Nonlinear Inverse Problems

Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations

Optimal Bounds on Nonlinear Partial Differential Equations in Model Certification, Validation, and Experimental Design

Forward and Inverse Uncertainty Quantification using Multilevel Monte Carlo Algorithms for an Elliptic Nonlocal Equation

Quasi-Monte Carlo for partial differential equations with generalized Gaussian input uncertainty

Sensitivity-enhanced generalized polynomial chaos for efficient uncertainty quantification

An introduction to uncertainty quantification for kinetic equations and related problems

Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning

A Dimension-adaptive Combination Technique for Uncertainty Quantification

Aleatory uncertainty quantification based on multi-fidelity deep neural networks

Uncertainty Quantification For Turbulent Flows with Machine Learning

Efficient uncertainty propagation for network multiphysics systems

Randomized Physics-Informed Machine Learning for Uncertainty Quantification in High-Dimensional Inverse Problems

Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific applications

Parabolic PDE-constrained optimal control under uncertainty with entropic risk measure using quasi-Monte Carlo integration

Assessment of Uncertainty Quantification in Universal Differential Equations