Abstract:Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional machine learning to address issues such as data sparsity and overfitting in neural networks. In this work, we apply MTL to problems in science and engineering governed by partial differential equations (PDEs). However, implementing MTL in this context is complex, as it requires task-specific modifications to accommodate various scenarios representing different physical processes. To this end, we present a multi-task deep operator network (MT-DeepONet) to learn solutions across various functional forms of source terms in a PDE and multiple geometries in a single concurrent training session. We introduce modifications in the branch network of the vanilla DeepONet to account for various functional forms of a parameterized coefficient in a PDE. Additionally, we handle parameterized geometries by introducing a binary mask in the branch network and incorporating it into the loss term to improve convergence and generalization to new geometry tasks. Our approach is demonstrated on three benchmark problems: (1) learning different functional forms of the source term in the Fisher equation; (2) learning multiple geometries in a 2D Darcy Flow problem and showcasing better transfer learning capabilities to new geometries; and (3) learning 3D parameterized geometries for a heat transfer problem and demonstrate the ability to predict on new but similar geometries. Our MT-DeepONet framework offers a novel approach to solving PDE problems in engineering and science under a unified umbrella based on synergistic learning that reduces the overall training cost for neural operators.

Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs

Diffeomorphism Neural Operator for various domains and parameters of partial differential equations

CoNO: Complex Neural Operator for Continous Dynamical Physical Systems

Enhancing Solutions for Complex PDEs: Introducing Complementary Convolution and Equivariant Attention in Fourier Neural Operators

Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discovery

Latent Neural Operator for Solving Forward and Inverse PDE Problems

Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning

Convolutional Neural Operators for robust and accurate learning of PDEs

Physics-Informed Geometry-Aware Neural Operator

CoNO: Complex Neural Operator for Continuous Dynamical Systems

Synergistic Learning with Multi-Task DeepONet for Efficient PDE Problem Solving

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations

Domain Agnostic Fourier Neural Operators

Pretraining a Neural Operator in Lower Dimensions

Local neural operator for solving transient partial differential equations on varied domains

Deciphering and integrating invariants for neural operator learning with various physical mechanisms

Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responses

DimOL: Dimensional Awareness as A New 'Dimension' in Operator Learning

Latent Neural Operator Pretraining for Solving Time-Dependent PDEs

Deep Equilibrium Based Neural Operators for Steady-State PDEs

Neural Operators for Accelerating Scientific Simulations and Design