Abstract:Physics informed neural networks (PINNs) are capable of finding the solution for a given boundary value problem. Here, the training of the network is equivalent to the minimization of a loss function that includes the governing (partial differential) equations (PDE) as well as initial and boundary conditions. We employ several ideas from the finite element method (FEM) to enhance the performance of existing PINNs in engineering problems. The main contribution of the current work is to promote using the spatial gradient of the primary variable as an output from separated neural networks. Later on, the strong form (given governing equation) which has a higher order of derivatives is applied to the spatial gradients of the primary variable as the physical constraint. In addition, the so-called energy form of the problem (which can be obtained from the weak form) is applied to the primary variable as an additional constraint for training. The proposed approach only required up to first-order derivatives to construct the physical loss functions. We discuss why this point is beneficial through various comparisons between different models. The mixed formulation-based PINNs and FE methods share some similarities. While the former minimizes the PDE and its energy form at given collocation points utilizing a complex nonlinear interpolation through a neural network, the latter does the same at element nodes with the help of shape functions. We focus on heterogeneous solids and check the performance of the proposed PINN model against the solution from FEM on two prototype problems: elasticity and the Poisson equation (steady-state diffusion problem). It is concluded that by properly designing the network architecture in PINN, the deep learning model has the potential to solve the unknowns in a heterogeneous domain without any available initial data from other sources. Finally, discussions are provided on the combination of PINN and data from physical FE simulations for a fast and accurate design of composite materials in future developments.

Enhancing convergence speed with feature enforcing physics-informed neural networks using boundary conditions as prior knowledge

Enhancing Convergence Speed with Feature-Enforcing Physics-Informed Neural Networks: Utilizing Boundary Conditions as Prior Knowledge for Faster Convergence

Accelerating Physics-Informed Neural Network Training with Prior Dictionaries

Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks

A mixed formulation for physics-informed neural networks as a potential solver for engineering problems in heterogeneous domains: Comparison with finite element method

Residual-based attention in physics-informed neural networks

Efficient training of physics-informed neural networks via importance sampling

Extremization to Fine Tune Physics Informed Neural Networks for Solving Boundary Value Problems

Recipes for when physics fails: recovering robust learning of physics informed neural networks

Loss-attentional physics-informed neural networks

Parallel Physics-Informed Neural Networks with Bidirectional Balance

Accelerated Training of Physics-Informed Neural Networks (PINNs) using Meshless Discretizations

Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations

Theory-guided physics-informed neural networks for boundary layer problems with singular perturbation

Pre-Training Physics-Informed Neural Network with Mixed Sampling and Its Application in High-Dimensional Systems

ConFIG: Towards Conflict-free Training of Physics Informed Neural Networks

Efficient training of physics‐informed neural networks via importance sampling

Critical Investigation of Failure Modes in Physics-informed Neural Networks

Physics-informed neural networks for incompressible flows with moving boundaries

PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networks

Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations