Abstract:Physics-informed neural networks (PINNs) are a class of deep learning models that utilize physics as differential equations to address complex problems, including ones that may involve limited data availability. However, tackling solutions of differential equations with oscillations or singular perturbations and shock-like structures becomes challenging for PINNs. Considering these challenges, we designed an efficient wavelet-based PINNs (W-PINNs) model to solve singularly perturbed differential equations. Here, we represent the solution in wavelet space using a family of smooth-compactly supported wavelets. This framework represents the solution of a differential equation with significantly fewer degrees of freedom while still retaining in capturing, identifying, and analyzing the local structure of complex physical phenomena. The architecture allows the training process to search for a solution within wavelet space, making the process faster and more accurate. The proposed model does not rely on automatic differentiations for derivatives involved in differential equations and does not require any prior information regarding the behavior of the solution, such as the location of abrupt features. Thus, through a strategic fusion of wavelets with PINNs, W-PINNs excel at capturing localized nonlinear information, making them well-suited for problems showing abrupt behavior in certain regions, such as singularly perturbed problems. The efficiency and accuracy of the proposed neural network model are demonstrated in various test problems, i.e., highly singularly perturbed nonlinear differential equations, the FitzHugh-Nagumo (FHN), and Predator-prey interaction models. The proposed design model exhibits impressive comparisons with traditional PINNs and the recently developed wavelet-based PINNs, which use wavelets as an activation function for solving nonlinear differential equations.

wPINNs: Weak Physics Informed Neural Networks for Approximating Entropy Solutions of Hyperbolic Conservation Laws

Improving Weak PINNs for Hyperbolic Conservation Laws: Dual Norm Computation, Boundary Conditions and Systems

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEs

Convergence and error analysis of PINNs

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Recipes for when physics fails: recovering robust learning of physics informed neural networks

Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time

A certified wavelet-based physics-informed neural network for the solution of parameterized partial differential equations

Physics-informed attention-based neural network for hyperbolic partial differential equations: application to the Buckley-Leverett problem

B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data

Error-Aware B-PINNs: Improving Uncertainty Quantification in Bayesian Physics-Informed Neural Networks

Robust error estimates of PINN in one-dimensional boundary value problems for linear elliptic equations

Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting

SetPINNs: Set-based Physics-informed Neural Networks

Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networks

Convergence and error control of consistent PINNs for elliptic PDEs

An efficient wavelet-based physics-informed neural networks for singularly perturbed problems

Understanding the Difficulty of Solving Cauchy Problems with PINNs

Physics-informed attention-based neural network for solving non-linear partial differential equations