Abstract:<p>Physics‐informed neural networks (PINNs) are a class of deep neural networks that are trained, using automatic differentiation, to compute the response of systems governed by partial differential equations (PDEs). The training of PINNs is simulation free, and does not require any training data set to be obtained from numerical PDE solvers. Instead, it only requires the physical problem description, including the governing laws of physics, domain geometry, initial/boundary conditions, and the material properties. This training usually involves solving a nonconvex optimization problem using variants of the stochastic gradient descent method, with the gradient of the loss function approximated on a batch of collocation points, selected randomly in each iteration according to a uniform distribution. Despite the success of PINNs in accurately solving a wide variety of PDEs, the method still requires improvements in terms of computational efficiency. To this end, in this paper, we study the performance of an importance sampling approach for efficient training of PINNs. Using numerical examples together with theoretical evidences, we show that in each training iteration, sampling the collocation points according to a distribution proportional to the loss function will improve the convergence behavior of the PINNs training. Additionally, we show that providing a piecewise constant approximation to the loss function for faster importance sampling can further improve the training efficiency. This importance sampling approach is straightforward and easy to implement in the existing PINN codes, and also does not introduce any new hyperparameter to calibrate. The numerical examples include elasticity, diffusion, and plane stress problems, through which we numerically verify the accuracy and efficiency of the importance sampling approach compared to the predominant uniform sampling approach.</p>

Efficient physics-informed neural networks using hash encoding

Accelerated Training of Physics-Informed Neural Networks (PINNs) using Meshless Discretizations

Densely Multiplied Physics Informed Neural Networks

Efficient training of physics-informed neural networks via importance sampling

GaborPINN: Efficient physics informed neural networks using multiplicative filtered networks

Accelerating Physics-Informed Neural Network Training with Prior Dictionaries

Learning Physics-Informed Neural Networks without Stacked Back-propagation

Residual resampling-based physics-informed neural network for neutron diffusion equations

Efficient training of physics‐informed neural networks via importance sampling

PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networks

Architectural Strategies for the optimization of Physics-Informed Neural Networks

TT-PINN: A Tensor-Compressed Neural PDE Solver for Edge Computing

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositions

Parallel Physics-Informed Neural Networks with Bidirectional Balance

Multiple Wavefield Solutions in Physics-Informed Neural Networks Using Latent Representation

Efficient Discrete Physics-informed Neural Networks for Addressing Evolutionary Partial Differential Equations

RoPINN: Region Optimized Physics-Informed Neural Networks

Physics-informed neural networks based on adaptive weighted loss functions for Hamilton-Jacobi equations

Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting