Abstract:<p>Physics‐informed neural networks (PINNs) are a class of deep neural networks that are trained, using automatic differentiation, to compute the response of systems governed by partial differential equations (PDEs). The training of PINNs is simulation free, and does not require any training data set to be obtained from numerical PDE solvers. Instead, it only requires the physical problem description, including the governing laws of physics, domain geometry, initial/boundary conditions, and the material properties. This training usually involves solving a nonconvex optimization problem using variants of the stochastic gradient descent method, with the gradient of the loss function approximated on a batch of collocation points, selected randomly in each iteration according to a uniform distribution. Despite the success of PINNs in accurately solving a wide variety of PDEs, the method still requires improvements in terms of computational efficiency. To this end, in this paper, we study the performance of an importance sampling approach for efficient training of PINNs. Using numerical examples together with theoretical evidences, we show that in each training iteration, sampling the collocation points according to a distribution proportional to the loss function will improve the convergence behavior of the PINNs training. Additionally, we show that providing a piecewise constant approximation to the loss function for faster importance sampling can further improve the training efficiency. This importance sampling approach is straightforward and easy to implement in the existing PINN codes, and also does not introduce any new hyperparameter to calibrate. The numerical examples include elasticity, diffusion, and plane stress problems, through which we numerically verify the accuracy and efficiency of the importance sampling approach compared to the predominant uniform sampling approach.</p>

VS-PINN: A fast and efficient training of physics-informed neural networks using variable-scaling methods for solving PDEs with stiff behavior

A Spatial-Temporally Adaptive PINN Framework for 3D Bi-Ventricular Electrophysiological Simulations and Parameter Inference

Accelerated Training of Physics-Informed Neural Networks (PINNs) using Meshless Discretizations

Pre-training strategy for solving evolution equations based on physics-informed neural networks

SK-PINN: Accelerated physics-informed deep learning by smoothing kernel gradients

ST-PINN: A Self-Training Physics-Informed Neural Network for Partial Differential Equations

Efficient training of physics-informed neural networks via importance sampling

A simple remedy for failure modes in physics informed neural networks

SVD-PINNs: Transfer Learning of Physics-Informed Neural Networks via Singular Value Decomposition

Solving stiff ordinary differential equations using physics informed neural networks (PINNs): simple recipes to improve training of vanilla-PINNs

Recipes for when physics fails: recovering robust learning of physics informed neural networks

An Expert's Guide to Training Physics-informed Neural Networks

CP-PINNs: Data-Driven Changepoints Detection in PDEs Using Online Optimized Physics-Informed Neural Networks

Adaptive Task Decomposition Physics-Informed Neural Networks

Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning

A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositions

Parameterized Physics-informed Neural Networks for Parameterized PDEs

An Efficient Framework for Solving Forward and Inverse Problems of Nonlinear Partial Differential Equations Via Enhanced Physics-Informed Neural Network Based on Adaptive Learning

Efficient training of physics‐informed neural networks via importance sampling

MRF-PINN: A Multi-Receptive-Field convolutional physics-informed neural network for solving partial differential equations

NAS-PINN: Neural architecture search-guided physics-informed neural network for solving PDEs