Abstract:Operator learning has become a powerful tool in machine learning for modeling complex physical systems governed by partial differential equations (PDEs). Although Deep Operator Networks (DeepONet) show promise, they require extensive data acquisition. Physics-informed DeepONets (PI-DeepONet) mitigate data scarcity but suffer from inefficient training processes. We introduce Separable Operator Networks (SepONet), a novel framework that significantly enhances the efficiency of physics-informed operator learning. SepONet uses independent trunk networks to learn basis functions separately for different coordinate axes, enabling faster and more memory-efficient training via forward-mode automatic differentiation. We provide a universal approximation theorem for SepONet proving that it generalizes to arbitrary operator learning problems, and then validate its performance through comprehensive benchmarking against PI-DeepONet. Our results demonstrate SepONet's superior performance across various nonlinear and inseparable PDEs, with SepONet's advantages increasing with problem complexity, dimension, and scale. For 1D time-dependent PDEs, SepONet achieves up to $112\times$ faster training and $82\times$ reduction in GPU memory usage compared to PI-DeepONet, while maintaining comparable accuracy. For the 2D time-dependent nonlinear diffusion equation, SepONet efficiently handles the complexity, achieving a 6.44\% mean relative $\ell_{2}$ test error, while PI-DeepONet fails due to memory constraints. This work paves the way for extreme-scale learning of continuous mappings between infinite-dimensional function spaces. Open source code is available at \url{<a class="link-external link-https" href="https://github.com/HewlettPackard/separable-operator-networks" rel="external noopener nofollow">this https URL</a>}.

Learning the solution operator of a nonlinear parabolic equation using physics informed deep operator network

Learning the solution operator of parametric partial differential equations with physics-informed DeepONets

Operator Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations Characterized by Sharp Solutions

Solving forward and inverse PDE problems on unknown manifolds via physics-informed neural operators

Data-driven and physics-informed deep learning operators for solution of heat conduction equation with parametric heat source

What do physics-informed DeepONets learn? Understanding and improving training for scientific computing applications

Physics-Informed Deep Inverse Operator Networks for Solving PDE Inverse Problems

Newton Informed Neural Operator for Computing Multiple Solutions of Nonlinear Partials Differential Equations

Physics-Informed Deep Neural Operator Networks

Learning Only on Boundaries: A Physics-Informed Neural Operator for Solving Parametric Partial Differential Equations in Complex Geometries

Physics-Informed Tailored Finite Point Operator Network for Parametric Interface Problems

Neural Parameter Regression for Explicit Representations of PDE Solution Operators

Physics-Informed Neural Operator for Learning Partial Differential Equations

Separable Operator Networks

Training a Deep Operator Network As a Surrogate Solver for Two-Dimensional Parabolic-Equation Models.

PinnDE: Physics-Informed Neural Networks for Solving Differential Equations

Learning Partial Differential Equations with Deep Parallel Neural Operator

Learning Generic Solutions for Multiphase Transport in Porous Media via the Flux Functions Operator

One-shot learning for solution operators of partial differential equations

DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splitting