Abstract:Recent advances in generative artificial intelligence have had a significant impact on diverse domains spanning computer vision, natural language processing, and drug discovery. This work extends the reach of generative models into physical problem domains, particularly addressing the efficient enforcement of physical laws and conditioning for forward and inverse problems involving partial differential equations (PDEs). Our work introduces two key contributions: firstly, we present an efficient approach to promote consistency with the underlying PDE. By incorporating discretized information into score-based generative models, our method generates samples closely aligned with the true data distribution, showcasing residuals comparable to data generated through conventional PDE solvers, significantly enhancing fidelity. Secondly, we showcase the potential and versatility of score-based generative models in various physics tasks, specifically highlighting surrogate modeling as well as probabilistic field reconstruction and inversion from sparse measurements. A robust foundation is laid by designing unconditional score-based generative models that utilize reversible probability flow ordinary differential equations. Leveraging conditional models that require minimal training, we illustrate their flexibility when combined with a frozen unconditional model. These conditional models generate PDE solutions by incorporating parameters, macroscopic quantities, or partial field measurements as guidance. The results illustrate the inherent flexibility of score-based generative models and explore the synergy between unconditional score-based generative models and the present physically-consistent sampling approach, emphasizing the power and flexibility in solving for and inverting physical fields governed by differential equations, and in other scientific machine learning tasks.

Solving Inverse Physics Problems with Score Matching

Conditional score-based diffusion models for solving inverse problems in mechanics

A Score-based Generative Solver for PDE-constrained Inverse Problems with Complex Priors

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

CoCoGen: Physically-Consistent and Conditioned Score-based Generative Models for Forward and Inverse Problems

Scale-invariant Learning by Physics Inversion

Solving inverse problems in physics by optimizing a discrete loss: Fast and accurate learning without neural networks

Physics Constrained Learning for Data-driven Inverse Modeling from Sparse Observations

Solving Inverse Heat Transfer Problems Without Surrogate Models: A Fast, Data-Sparse, Physics Informed Neural Network Approach

Score-Based Variational Inference for Inverse Problems

Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods

Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck Equations

Score matching for bridges without time-reversals

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models

Repulsive Latent Score Distillation for Solving Inverse Problems

Solving Inverse Problems via Diffusion Optimal Control

Solving inverse-PDE problems with physics-aware neural networks

Reducing the cost of posterior sampling in linear inverse problems via task-dependent score learning

Denoising Score-Matching for Uncertainty Quantification in Inverse Problems

Efficient Bayesian inference using physics-informed invertible neural networks for inverse problems

Solving Inverse Stochastic Problems from Discrete Particle Observations Using the Fokker-Planck Equation and Physics-informed Neural Networks