Abstract:We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be computational prohibitive using classical methods, particularly when a large number of samples is needed to evaluate risk measures at every iteration of an optimization algorithm, where each sample requires the solution of an expensive-to-solve PDE. To address this challenge, we propose a new neural operator approximation of the PDE solution operator that has the combined merits of (1) accurate approximation of not only the map from the joint inputs of random parameters and optimization variables to the PDE state, but also its derivative with respect to the optimization variables, (2) efficient construction of the neural network using reduced basis architectures that are scalable to high-dimensional OUU problems, and (3) requiring only a limited number of training data to achieve high accuracy for both the PDE solution and the OUU solution. We refer to such neural operators as multi-input reduced basis derivative informed neural operators (MR-DINOs). We demonstrate the accuracy and efficiency our approach through several numerical experiments, i.e. the risk-averse control of a semilinear elliptic PDE and the steady state Navier--Stokes equations in two and three spatial dimensions, each involving random field inputs. Across the examples, MR-DINOs offer $10^{3}$--$10^{7} \times$ reductions in execution time, and are able to produce OUU solutions of comparable accuracies to those from standard PDE based solutions while being over $10 \times$ more cost-efficient after factoring in the cost of construction.

Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations

Diffeomorphism Neural Operator for various domains and parameters of partial differential equations

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations

Physics-Informed Geometry-Aware Neural Operator

Efficient PDE-Constrained optimization under high-dimensional uncertainty using derivative-informed neural operators

Local neural operator for solving transient partial differential equations on varied domains

Neural Inverse Operators for Solving PDE Inverse Problems

Learning Neural Operators on Riemannian Manifolds

Deep Equilibrium Based Neural Operators for Steady-State PDEs

Convolutional Neural Operators for robust and accurate learning of PDEs

Koopman neural operator as a mesh-free solver of non-linear partial differential equations

Resolution invariant deep operator network for PDEs with complex geometries

Latent Neural Operator for Solving Forward and Inverse PDE Problems

Fourier Neural Operator with Learned Deformations for PDEs on General Geometries

Geometry-Informed Neural Operator for Large-Scale 3D PDEs

Operator Learning with Neural Fields: Tackling PDEs on General Geometries

Neural Operators for Accelerating Scientific Simulations and Design

Learning Partial Differential Equations with Deep Parallel Neural Operator

Learning Transient Partial Differential Equations with Local Neural Operators

Neural Operator: Learning Maps Between Function Spaces