Abstract:Physics-informed neural networks (PINNs) have shown to be effective tools for solving both forward and inverse problems of partial differential equations (PDEs). PINNs embed the PDEs into the loss of the neural network using automatic differentiation, and this PDE loss is evaluated at a set of scattered spatio-temporal points (called residual points). The location and distribution of these residual points are highly important to the performance of PINNs. However, in the existing studies on PINNs, only a few simple residual point sampling methods have mainly been used. Here, we present a comprehensive study of two categories of sampling for PINNs: non-adaptive uniform sampling and adaptive nonuniform sampling. We consider six uniform sampling methods, including (1) equispaced uniform grid, (2) uniformly random sampling, (3) Latin hypercube sampling, (4) Halton sequence, (5) Hammersley sequence, and (6) Sobol sequence. We also consider a resampling strategy for uniform sampling. To improve the sampling efficiency and the accuracy of PINNs, we propose two new residual-based adaptive sampling methods: residual-based adaptive distribution (RAD) and residual-based adaptive refinement with distribution (RAR-D), which dynamically improve the distribution of residual points based on the PDE residuals during training. Hence, we have considered a total of 10 different sampling methods, including six non-adaptive uniform sampling, uniform sampling with resampling, two proposed adaptive sampling, and an existing adaptive sampling. We extensively tested the performance of these sampling methods for four forward problems and two inverse problems in many setups. Our numerical results presented in this study are summarized from more than 6000 simulations of PINNs. We show that the proposed adaptive sampling methods of RAD and RAR-D significantly improve the accuracy of PINNs with fewer residual points for both forward and inverse problems. The results obtained in this study can also be used as a practical guideline in choosing sampling methods.

Solving Complex Electromagnetic Scattering Problem Based on Physics-Informed Neural Network with Adaptive Sampling Method

Solving Electromagnetic Problems with PINN Based on Scattering Equivalent Source Method

Acoustic Field Visualization and Source Localization Via Physics-Informed Learning of Sparse Data with Adaptive Sampling

Physics-Informed Neural Networks for Solving 2-D Magnetostatic Fields

An End-to-End Neural Network for Complex Electromagnetic Simulations

A More General Electromagnetic Inverse Scattering Method Based on Physics-Informed Neural Network

Physics-Informed Neural Networks for Solving Two-Dimensional Magneto-Static Fields

Multiple scattering simulation via physics-informed neural networks

Approximating electromagnetic fields in discontinuous media using a single physics-informed neural network

Effects of Sampling Strategies and Optimization Methods on Solving Wave Equation with Physics-Informed Neural Network

A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks

Deep Learning with Attention Mechanism for Electromagnetic Inverse Scattering

Learning-Based Fast Electromagnetic Scattering Solver Through Generative Adversarial Network

Surface profile recovery from electromagnetic field with physics--informed neural networks

Hybrid Dilated Convolutional Neural Network for Solving Electromagnetic Inverse Scattering Problems

Solving Two-Dimensional Scattering From Multiple Dielectric Cylinders by Artificial Neural Network Accelerated Numerical Green's Function

An Adaptive Sampling Algorithm with Dynamic Iterative Probability Adjustment Incorporating Positional Information

Surface Profile Recovery from Electromagnetic Fields with Physics-Informed Neural Networks

Taper-based scattering formulation of the Helmholtz equation to improve the training process of Physics-Informed Neural Networks

Adaptive Sampling Points Based Multi-Scale Residual Network for Solving Partial Differential Equations

Physics-informed Deep Learning to Solve 2D Electromagnetic Scattering Problems