Abstract:In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems necessitates leveraging prior information to achieve well-posedness. In most existing inverse solvers, the prior distribution is assumed to be of either Gaussian or Laplace form which, in many practical scenarios, is an oversimplification. In case the prior is complex and the likelihood model is computationally expensive (e.g., due to expensive forward models), drawing the sample from such posteriors can be computationally intractable, especially when the unknown parameter is high-dimensional. In this work, to sample efficiently, we propose a score-based diffusion model, which combines a score-based generative sampling tool with a noising and denoising process driven by stochastic differential equations. This tool is used for iterative sample generation in accordance with the posterior distribution, while simultaneously learning and leveraging the underlying information and constraints inherent in the given complex prior. A time-varying time schedule is proposed to adapt the method for posterior sampling. To expedite the simulation of non-parameterized PDEs and enhance the generalization capacity, we introduce a physics-informed convolutional neural network (CNN) surrogate for the forward model. Finally, numerical experiments, including a hyper-elastic problem and a multi-scale mechanics problem, demonstrate the efficacy of the proposed approach. In particular, the score-based diffusion model, coupled with the physics-informed CNN surrogate, effectively learns geometrical features from provided prior samples, yielding better inverse estimation results compared to the state-of-the-art techniques.

Score-Based Variational Inference for Inverse Problems

Repulsive Latent Score Distillation for Solving Inverse Problems

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

A Variational Perspective on Solving Inverse Problems with Diffusion Models

VI-DGP: A Variational Inference Method with Deep Generative Prior for Solving High-Dimensional Inverse Problems

A Score-based Generative Solver for PDE-constrained Inverse Problems with Complex Priors

Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problems

Conditional score-based diffusion models for solving inverse problems in mechanics

Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

A variational inference framework for inverse problems

Variational Diffusion Posterior Sampling with Midpoint Guidance

VARIATIONAL BAYES' METHOD FOR FUNCTIONS WITH APPLICATIONS TO SOME INVERSE PROBLEMS

Inverse Problems with Diffusion Models: A MAP Estimation Perspective

Score-Based Diffusion Models as Principled Priors for Inverse Imaging

Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior

Stein Variational Gradient Descent on Infinite-Dimensional Space and Applications to Statistical Inverse Problems

Markovian Score Climbing: Variational Inference with KL(p||q)

Reducing the cost of posterior sampling in linear inverse problems via task-dependent score learning

Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems

Solving Inverse Physics Problems with Score Matching

Transport Score Climbing: Variational Inference Using Forward KL and Adaptive Neural Transport