Abstract:Operator learning has become a powerful tool in machine learning for modeling complex physical systems governed by partial differential equations (PDEs). Although Deep Operator Networks (DeepONet) show promise, they require extensive data acquisition. Physics-informed DeepONets (PI-DeepONet) mitigate data scarcity but suffer from inefficient training processes. We introduce Separable Operator Networks (SepONet), a novel framework that significantly enhances the efficiency of physics-informed operator learning. SepONet uses independent trunk networks to learn basis functions separately for different coordinate axes, enabling faster and more memory-efficient training via forward-mode automatic differentiation. We provide a universal approximation theorem for SepONet proving that it generalizes to arbitrary operator learning problems, and then validate its performance through comprehensive benchmarking against PI-DeepONet. Our results demonstrate SepONet's superior performance across various nonlinear and inseparable PDEs, with SepONet's advantages increasing with problem complexity, dimension, and scale. For 1D time-dependent PDEs, SepONet achieves up to $112\times$ faster training and $82\times$ reduction in GPU memory usage compared to PI-DeepONet, while maintaining comparable accuracy. For the 2D time-dependent nonlinear diffusion equation, SepONet efficiently handles the complexity, achieving a 6.44\% mean relative $\ell_{2}$ test error, while PI-DeepONet fails due to memory constraints. This work paves the way for extreme-scale learning of continuous mappings between infinite-dimensional function spaces. Open source code is available at \url{<a class="link-external link-https" href="https://github.com/HewlettPackard/separable-operator-networks" rel="external noopener nofollow">this https URL</a>}.

Deep Multi-Input and Multi-Output Operator Networks Method for Optimal Control of Pdes

Different‐factor Compact‐form Model‐free Adaptive Control with Neural Networks for MIMO Nonlinear Systems

An Operator Learning Approach to Nonsmooth Optimal Control of Nonlinear PDEs

Separable Operator Networks

Multilinear Model Decomposition of MIMO Nonlinear Systems and Its Implication for Multilinear Model-Based Control

Newton Informed Neural Operator for Computing Multiple Solutions of Nonlinear Partials Differential Equations

MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problems

LeMON: Learning to Learn Multi-Operator Networks

Intelligent acceleration adaptive control of linear $2\times2$ hyperbolic PDE systems

Learning the solution operator of a nonlinear parabolic equation using physics informed deep operator network

Solving forward and inverse PDE problems on unknown manifolds via physics-informed neural operators

MIONet: Learning multiple-input operators via tensor product

M^2M: Learning Controllable Multi of Experts and Multi-Scale Operators Are the Partial Differential Equations Need

DeepONet as a Multi-Operator Extrapolation Model: Distributed Pretraining with Physics-Informed Fine-Tuning

Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems

B-LSTM-MIONet: Bayesian LSTM-based Neural Operators for Learning the Response of Complex Dynamical Systems to Length-Variant Multiple Input Functions

Learning Instance-Solution Operator For Optimal Control

A PINN approach for the online identification and control of unknown PDEs

MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs

Hamilton-Jacobi Based Policy-Iteration via Deep Operator Learning

AONN: an Adjoint-Oriented Neural Network Method for All-at-once Solutions of Parametric Optimal Control Problems