Abstract:Summary Accurate numerical modeling of multiphase flow and transport mechanisms is essential to study varied, complex physical phenomena including flow in subsurface oil and gas reservoirs and subsurface aquifers subject to CO2 sequestration. State-of-the-art complete physics-based solvers suffer from many computational challenges. High-fidelity data-driven surrogate models that solve the governing partial differential equations (PDEs) have the potential to optimize the time to solution and increase confidence in critical business and engineering decisions through better quantification of solution statistics. We leverage the recently proposed Fourier neural operators (FNOs) with quasilinear time complexity to capture the spectral information from feature maps to solve the coupled porous flow and transport PDEs. Embedding Fourier layers within the residual blocks results in a highly effective structure that, while achieving competitive accuracy, also enables efficient training of deeper networks with a dramatically reduced number of trainable parameters. The resulting novel deep-learning (DL) architecture is coined as FResNet++. FResNet++ uses squeeze and excitation blocks, atrous spatial pyramid pooling (ASPP), and attention blocks to increase its sensitivity to the relevant features and capture multiscale information, and it is specifically tuned to operate optimally to learn from and predict numerically simulated flow (pressure and saturation) fields. We demonstrate the ability of FResNet++ to generalize over multiple high-dimensional input parameter spaces that describe subsurface permeability and porosity heterogeneity. The resulting DL architecture accurately captures the complex interplay between viscous forces and highly heterogeneous permeability and porosity fields. We investigate two-phase flow in porous media, which is the archetypal problem for reservoir simulation giving rise to a system of nonlinearly coupled PDEs with highly heterogeneous coefficients. We show in blind tests that FResNet++ predicts saturation fields more accurately compared to ResU-Net and original FNO with fully connected linear layers. We additionally investigate the effects of using alternative loss functions and an alternative way of utilizing FResNet++ to increase its effectiveness. For the first time in the literature, we show that the spatiotemporal evolution of pressure and saturation fields can be jointly predicted with good accuracy using a single FResNet++ network over long time horizons in response to previously unseen permeability and porosity fields. After a moderate training investment on graphics processing units (GPUs), FResNet++ yields a speedup of at least four orders of magnitude compared to a conventional numerical PDE solver and operates with notably fewer trainable parameters compared to the original FNO. Our numerical experiments validate that FNOs can be utilized in various convolutional neural network-based architectures and can effectively substitute for repetitive physics-based forward simulations for scenario testing.

Transfer Learning Fourier Neural Operator for Solving Parametric Frequency-Domain Wave Equations

Fourier Neural Operator for Solving Subsurface Oil/Water Two-Phase Flow Partial Differential Equation

Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs

Enhancing subsurface multiphase flow simulation with Fourier neural operator

Model-Parallel Fourier Neural Operators as Learned Surrogates for Large-Scale Parametric PDEs

Gabor-Filtered Fourier Neural Operator for Solving Partial Differential Equations

MgFNO: Multi-grid Architecture Fourier Neural Operator for Parametric Partial Differential Equations

Enhancing Solutions for Complex PDEs: Introducing Complementary Convolution and Equivariant Attention in Fourier Neural Operators

Fourier Neural Operator with Learned Deformations for PDEs on General Geometries

3D elastic wave propagation with a Factorized Fourier Neural Operator (F-FNO)

Toward a Better Understanding of Fourier Neural Operators from a Spectral Perspective

A Born Fourier Neural Operator for Solving Poisson’s Equation with Limited Data and Arbitrary Domain Deformation

Augmenting Deep Residual Surrogates with Fourier Neural Operators for Rapid Two-Phase Flow and Transport Simulations

Learning the boundary-to-domain mapping using Lifting Product Fourier Neural Operators for partial differential equations

Fourier neural operator based fluid-structure interaction for predicting the vesicle dynamics

Rapid Surrogate Modeling of Electromagnetic Data in Frequency Domain Using Neural Operator.

Fourier neural operator based fluid–structure interaction for predicting the vesicle dynamics

Fourier neural operator for large eddy simulation of compressible Rayleigh-Taylor turbulence

Fourier neural operators for spatiotemporal dynamics in two-dimensional turbulence

Spectral-Refiner: Fine-Tuning of Accurate Spatiotemporal Neural Operator for Turbulent Flows

Fast Solver of 2D Maxwell's Equations Based on Fourier Neural Operator