Abstract:We propose a novel modular inference approach combining two different generative models — generative adversarial networks (GAN) and normalizing flows — to approximate the posterior distribution of physics-based Bayesian inverse problems framed in high-dimensional ambient spaces. We dub the proposed framework GAN-Flow. The proposed method leverages the intrinsic dimension reduction and superior sample generation capabilities of GANs to define a low-dimensional data-driven prior distribution. Once a trained GAN-prior is available, the inverse problem is solved entirely in the latent space of the GAN using variational Bayesian inference with normalizing flow-based variational distribution, which approximates low-dimensional posterior distribution by transforming realizations from the low-dimensional latent prior (Gaussian) to corresponding realizations of a low-dimensional variational posterior distribution. The trained GAN generator then maps realizations from this approximate posterior distribution in the latent space back to the high-dimensional ambient space. We also propose a two-stage training strategy for GAN-Flow wherein we train the two generative models sequentially. Thereafter, GAN-Flow can estimate the statistics of posterior-predictive quantities of interest at virtually no additional computational cost. The synergy between the two types of generative models allows us to overcome many challenges associated with the application of Bayesian inference to large-scale inverse problems, chief among which are describing an informative prior and sampling from the high-dimensional posterior. GAN-Flow does not involve Markov chain Monte Carlo simulation, making it particularly suitable for solving large-scale inverse problems. We demonstrate the efficacy and flexibility of GAN-Flow on various physics-based inverse problems of varying ambient dimensionality and prior knowledge using different types of GANs and normalizing flows. Notably, one of the applications we consider involves a 65,536-dimensional inverse problem of phase retrieval wherein an object is reconstructed from sparse noisy measurements of the magnitude of its Fourier transform.

Subgrid-scale parametrization of unresolved scales in forced Burgers equation using generative adversarial networks (GAN)

A Data-Driven Approach to Modeling Subgrid-Scale Shallow Marsh Hydrodynamics

Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems

Uncertainty quantification in a mechanical submodel driven by a Wasserstein-GAN

Using Physics-Informed Super-Resolution Generative Adversarial Networks for Subgrid Modeling in Turbulent Reactive Flows

Resolve subgrid microscale interactions to discretise stochastic partial differential equations

A sub-grid scale model for Burgers turbulence based on the artificial neural network method

Algorithmic Hallucinations of Near-Surface Winds: Statistical Downscaling with Generative Adversarial Networks to Convection-Permitting Scales

Generalization capabilities of conditional GAN for turbulent flow under changes of geometry

Local Turbulence Generation Using Conditional Generative Adversarial Networks Toward Reynolds-averaged Navier-Stokes Modeling

Parametrization and generation of geological models with generative adversarial networks

Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model

Stochastic subgrid-scale parameterization for one-dimensional shallow water dynamics using stochastic mode reduction

A multiscale and multicriteria Generative Adversarial Network to synthesize 1-dimensional turbulent fields

A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flows

Predicting unavailable parameters from existing velocity fields of turbulent flows using a GAN-based model

Highly-scalable, physics-informed GANs for learning solutions of stochastic PDEs

Bayesian inference for geophysical fluid dynamics using generative models

GANs and Closures: Micro-Macro Consistency in Multiscale Modeling

Accelerating multigrid solver with generative super-resolution