Abstract:Physics-Informed Neural Networks (PINNs) have been successfully applied to solve Partial Differential Equations (PDEs). Their loss function is founded on a strong residual minimization scheme. Variational Physics-Informed Neural Networks (VPINNs) are their natural extension to weak variational settings. In this context, the recent work of Robust Variational Physics-Informed Neural Networks (RVPINNs) highlights the importance of conveniently translating the norms of the underlying continuum-level spaces to the discrete level. Otherwise, VPINNs might become unrobust, implying that residual minimization might be highly uncorrelated with a desired minimization of the error in the energy norm. However, applying this robustness to VPINNs typically entails dealing with the inverse of a Gram matrix, usually producing slow convergence speeds during training. In this work, we accelerate the implementation of RVPINN, establishing a LU factorization of sparse Gram matrix in a kind of point-collocation scheme with the same spirit as original PINNs. We call out method the Collocation-based Robust Variational Physics Informed Neural Networks (CRVPINN). We test our efficient CRVPINN algorithm on Laplace, advection-diffusion, and Stokes problems in two spatial dimensions.

What problem does this paper attempt to address?

The problem this paper attempts to address is how to accelerate and optimize the solving process based on Variational Physics-Informed Neural Networks (VPINNs), particularly for solving Partial Differential Equations (PDEs). Specifically, the paper proposes a new method—Configuration Robust Variational Physics-Informed Neural Networks (CRVPINN), aimed at overcoming the slow training speed in existing VPINN methods due to the need to handle the inverse of the Gram matrix. ### Background and Problem - **Existing Methods**: Traditional Physics-Informed Neural Networks (PINNs) solve PDEs through a strong residual minimization scheme, while Variational Physics-Informed Neural Networks (VPINNs) optimize under a weak variational setting. However, VPINNs can become unstable when dealing with certain problems, i.e., there is a high degree of irrelevance between residual minimization and energy norm error minimization. - **Robust Variational Physics-Informed Neural Networks (RVPINNs)**: RVPINNs improve robustness by multiplying the loss function with the inverse of the Gram matrix, but this often leads to the need for expensive integral calculations during training, resulting in slow training speed. ### Proposed Method - **CRVPINN**: The paper proposes a configuration point-based method that redefines the discrete weak form and discrete Poincaré inequality by using the Kronecker delta as the test function in the discrete domain. This method avoids expensive integral calculations and can efficiently solve the inverse of the Gram matrix through LU decomposition. - **Advantages**: - **Computational Efficiency**: Through LU decomposition, forward and backward substitutions can be performed at linear computational cost in each training step, significantly speeding up the training process. - **Applicability**: This method is suitable for a wide range of PDEs, especially when the right-hand side terms differ but the Gram matrix structure is similar, allowing the reuse of the same inverse Gram matrix. ### Experimental Validation The paper validates the effectiveness of CRVPINN through multiple 2D model problems, including the Laplace problem, convection-diffusion problem, Poisson problem, and Stokes problem. Experimental results show that CRVPINN not only converges quickly but also has a loss function very close to the true error, demonstrating good robustness. ### Conclusion By combining the configuration point method and robust loss function, CRVPINN successfully improves the computational efficiency and robustness of Variational Physics-Informed Neural Networks in solving PDEs, providing a new effective tool for addressing complex scientific computing problems.

Collocation-based Robust Variational Physics-Informed Neural Networks (CRVPINN)

Robust Variational Physics-Informed Neural Networks

Variational Physics-Informed Neural Networks For Solving Partial Differential Equations

Effects of variational formulations on physics‐informed neural network performance in solid mechanics

VW-PINNs: A volume weighting method for PDE residuals in physics-informed neural networks

Cv-Pinn: Efficient Learning of Variational Physics-Informed Neural Network with Domain Decomposition

Physics Informed Neural Networks with strong and weak residuals for advection-dominated diffusion problems

FastVPINNs: Tensor-Driven Acceleration of VPINNs for Complex Geometries

VC-PINN: Variable coefficient physics-informed neural network for forward and inverse problems of PDEs with variable coefficient

Recipes for when physics fails: recovering robust learning of physics informed neural networks

VI-PINNs: Variance-involved Physics-informed Neural Networks for Fast and Accurate Prediction of Partial Differential Equations

An efficient hp-Variational PINNs framework for incompressible Navier-Stokes equations

VC-PINN: Variable Coefficient Physical Information Neural Network For Forward And Inverse PDE Problems with Variable Coefficient

Physics-Informed Neural Networks with Trust-Region Sequential Quadratic Programming

RoPINN: Region Optimized Physics-Informed Neural Networks

Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networks

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges

Finite Volume Physical Informed Neural Network (FV-PINN) with Reduced Derivative Order for Incompressible Flows

Physics-Informed Neural Networks with Adaptive Localized Artificial Viscosity

Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What's Next