Abstract:Physics-informed neural networks (PINNs) have become a kind of attractive machine learning framework for obtaining solutions of partial differential equations (PDEs). PINNs embed initial, boundary, and PDE constraints into the loss function. The performance of PINNs is generally affected by both training and sampling. Specifically, training methods focus on how to overcome the training difficulties caused by the special PDE residual loss of PINNs, and sampling methods are related to the location and distribution of sampling points on which evaluation of PDE residual loss is accomplished. However, a common problem among these original PINNs is that they omit special temporal information utilization in neither training nor sampling levels when facing the important PDE category, i.e., time-dependent PDEs, where temporal information is the key point for algorithms. There is one work called causal PINN that considers temporal causality at the training level but lacks special temporal utilization at the sampling level. Incorporating temporal knowledge into sampling is still to be studied. To fill this gap, we propose a novel temporal causality-based adaptive sampling method that dynamically determines the sampling ratio according to both PDE residual and temporal causality. By designing a sampling ratio determined by both residual loss and temporal causality to control the number and location of sampled points in each temporal subdomain, we provide a practical solution by incorporating temporal information into sampling. Numerical experiments of several nonlinear time-dependent PDEs, including Cahn-Hilliard, KdV, Allen-Cahn, and Wave equations, show that our proposed sampling method can improve performance. We demonstrate that using such a relatively simple sampling method can improve prediction performance up to two orders of magnitude compared with other results, especially when points are limited.

Mass-preserving Spatio-temporal adaptive PINN for Cahn-Hilliard equations with strong nonlinearity and singularity

Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Physics-informed neural networks with parameter asymptotic strategy for learning singularly perturbed convection-dominated problem

Structure Preserving PINN for Solving Time Dependent PDEs with Periodic Boundary

Physics-informed neural networks based on adaptive weighted loss functions for Hamilton-Jacobi equations

NH-PINN: Neural homogenization based physics-informed neural network for multiscale problems

A Spatial-Temporally Adaptive PINN Framework for 3D Bi-Ventricular Electrophysiological Simulations and Parameter Inference

TCAS-PINN: Physics-informed neural networks with a novel temporal causality-based adaptive sampling method

Multistep Asymptotic Pre-Training Strategy Based on Pinns for Solving Steep Boundary Singular Perturbation Problems

Solution of conservative-form transport equations with physics-informed neural network

Pre-training strategy for solving evolution equations based on physics-informed neural networks

Improvement of Bayesian PINN Training Convergence in Solving Multi-scale PDEs with Noise

Pre-Training Physics-Informed Neural Network with Mixed Sampling and Its Application in High-Dimensional Systems

Gradient auxiliary physics-informed neural network for nonlinear biharmonic equation

A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations

The robust physics-informed neural networks for a typical fourth-order phase field model

Physical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansions

Generalized conditional symmetry enhanced physics-informed neural network and application to the forward and inverse problems of nonlinear diffusion equations

Semi-analytic PINN methods for singularly perturbed boundary value problems