Abstract:Summary Accurate numerical modeling of multiphase flow and transport mechanisms is essential to study varied, complex physical phenomena including flow in subsurface oil and gas reservoirs and subsurface aquifers subject to CO2 sequestration. State-of-the-art complete physics-based solvers suffer from many computational challenges. High-fidelity data-driven surrogate models that solve the governing partial differential equations (PDEs) have the potential to optimize the time to solution and increase confidence in critical business and engineering decisions through better quantification of solution statistics. We leverage the recently proposed Fourier neural operators (FNOs) with quasilinear time complexity to capture the spectral information from feature maps to solve the coupled porous flow and transport PDEs. Embedding Fourier layers within the residual blocks results in a highly effective structure that, while achieving competitive accuracy, also enables efficient training of deeper networks with a dramatically reduced number of trainable parameters. The resulting novel deep-learning (DL) architecture is coined as FResNet++. FResNet++ uses squeeze and excitation blocks, atrous spatial pyramid pooling (ASPP), and attention blocks to increase its sensitivity to the relevant features and capture multiscale information, and it is specifically tuned to operate optimally to learn from and predict numerically simulated flow (pressure and saturation) fields. We demonstrate the ability of FResNet++ to generalize over multiple high-dimensional input parameter spaces that describe subsurface permeability and porosity heterogeneity. The resulting DL architecture accurately captures the complex interplay between viscous forces and highly heterogeneous permeability and porosity fields. We investigate two-phase flow in porous media, which is the archetypal problem for reservoir simulation giving rise to a system of nonlinearly coupled PDEs with highly heterogeneous coefficients. We show in blind tests that FResNet++ predicts saturation fields more accurately compared to ResU-Net and original FNO with fully connected linear layers. We additionally investigate the effects of using alternative loss functions and an alternative way of utilizing FResNet++ to increase its effectiveness. For the first time in the literature, we show that the spatiotemporal evolution of pressure and saturation fields can be jointly predicted with good accuracy using a single FResNet++ network over long time horizons in response to previously unseen permeability and porosity fields. After a moderate training investment on graphics processing units (GPUs), FResNet++ yields a speedup of at least four orders of magnitude compared to a conventional numerical PDE solver and operates with notably fewer trainable parameters compared to the original FNO. Our numerical experiments validate that FNOs can be utilized in various convolutional neural network-based architectures and can effectively substitute for repetitive physics-based forward simulations for scenario testing.

Fourier neural operator based fluid–structure interaction for predicting the vesicle dynamics

Fourier neural operator based fluid-structure interaction for predicting the vesicle dynamics

Enhancing subsurface multiphase flow simulation with Fourier neural operator

Fourier Neural Operator for Solving Subsurface Oil/Water Two-Phase Flow Partial Differential Equation

Fourier Neural Operator for Fluid Flow in Small-Shape 2D Simulated Porous Media Dataset

Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs

Non-equispaced Fourier Neural Solvers for PDEs

Fourier Neural Operator Networks for Solving Reaction–Diffusion Equations

Enhancing Solutions for Complex PDEs: Introducing Complementary Convolution and Equivariant Attention in Fourier Neural Operators

Fourier Neural Operator with Learned Deformations for PDEs on General Geometries

Gabor-Filtered Fourier Neural Operator for Solving Partial Differential Equations

Augmenting Deep Residual Surrogates with Fourier Neural Operators for Rapid Two-Phase Flow and Transport Simulations

Fourier Neural Operator with Boundary Conditions for Efficient Prediction of Steady Airfoil Flows

Transfer Learning Fourier Neural Operator for Solving Parametric Frequency-Domain Wave Equations

Spectral-Refiner: Fine-Tuning of Accurate Spatiotemporal Neural Operator for Turbulent Flows

Fourier neural operators for spatiotemporal dynamics in two-dimensional turbulence

Fredholm Integral Equations Neural Operator (FIE-NO) for Data-Driven Boundary Value Problems

Enhancing Learning to Solve Multicomponent Fractional Viscoelastic Equations with U-net Fourier Neural Operators

Numerical Investigation of Nonlinear Fluid–structure Interaction Dynamic Behaviors under a General Immersed Boundary-Lattice Boltzmann-Finite Element Method

Differentiable hybrid neural modeling for fluid-structure interaction

Solving Flows Across Rotor and Stator Cascades with Local Neural Operator for Computational Fluid Dynamics