Abstract:Physics-Informed Neural Networks (PINNs) and extended PINNs (XPINNs) have emerged as a promising approach in computational science and engineering for solving partial differential equations (PDEs) by combining the power of artificial intelligence (AI) with the underlying physics to accurately model and predict the solutions to complex problems in science and engineering. In this work, we propose the augmented physics-informed neural network (APINN), which adopts soft and trainable domain decomposition and flexible parameter sharing to further improve the extended PINN (XPINN) as well as the vanilla PINN methods. Concretely, a trainable gate network is employed to mimic the hard decomposition of XPINN, which can be flexibly fine-tuned for discovering a potentially better partition. The gate network satisfying the partition-of-unity property, weighted averages several sub-networks as the final output. APINN does not require complex interface conditions, whose sub-nets can utilize all training samples rather than just part of the training data in their subdomains. Lastly, each sub-net shares part of the common parameters to capture the similar components in each decomposed function. Furthermore, following the PINN generalization theory (Hu et al., 2022), APINN is shown to improve generalization by proper gate network initialization and general domain & function decomposition. Extensive experiments on different partial differential equations (PDEs) demonstrate how APINN improves PINN and XPINN. Specifically, we present examples where XPINN performs similarly to or worse than PINN, so that APINN can significantly improve both. We also show cases where XPINN is already better than PINN, so APINN can still slightly improve XPINN. Furthermore, we visualize the optimized gating networks and their optimization trajectories, and connect them with their performance, which helps discover the possibly optimal decomposition. Interestingly, if initialized by different decomposition, the performances of corresponding APINNs can differ drastically. This, in turn, shows the potential to design an optimal domain decomposition for the PDE under consideration.

TGPT-PINN: Nonlinear model reduction with transformed GPT-PINNs

Physics-informed Neural Networks to Solve Lumped Kinetic Model for Chromatography Process.

GPT-PINN: Generative Pre-Trained Physics-Informed Neural Networks toward non-intrusive Meta-learning of parametric PDEs

A non-intrusive neural network model order reduction algorithm for parameterized parabolic PDEs

CP-PINNs: Data-Driven Changepoints Detection in PDEs Using Online Optimized Physics-Informed Neural Networks

Pre-training strategy for solving evolution equations based on physics-informed neural networks

Revisiting PINNs: Generative Adversarial Physics-informed Neural Networks and Point-weighting Method

TDOR-MPINNs: Multi-output Physics-Informed Neural Networks Based on Time Differential Order Reduction for Solving Coupled Klein–Gordon–Zakharov Systems

Gradient-optimized physics-informed neural networks (GOPINNs): a deep learning method for solving the complex modified KdV equation

PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networks

A simple remedy for failure modes in physics informed neural networks

RoPINN: Region Optimized Physics-Informed Neural Networks

Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology

Learning Physics-Informed Neural Networks without Stacked Back-propagation

Reduced-PINN: An Integration-Based Physics-Informed Neural Networks for Stiff ODEs

Gradient auxiliary physics-informed neural network for nonlinear biharmonic equation

SetPINNs: Set-based Physics-informed Neural Networks

Recipes for when physics fails: recovering robust learning of physics informed neural networks

A Parsimonious Separated Representation Empowering PINN–PGD-Based Solutions for Parametrized Partial Differential Equations

Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting