Abstract:Classical numerical methods such as finite element method (FEM) face limitations due to their low efficiency when addressing large-scale problems. As a novel paradigm, the physics-informed neural network (PINN) has demonstrated significant potential to solve partial differential equations. However, conventional PINNs utilize meshless control at discrete sampling points, which limits their ability to effectively handle complex boundaries. Moreover, catastrophic failure may occur in the deep energy method (DEM, a specific type of PINN). To handle these challenges, this study proposes a Neural Network-augmented Differentiable Finite Element Method (NNDFEM) by combining PINN and finite element approximation. In NNDFEM, the neural network backend solely predicts nodal variables. Derivatives and complex boundary conditions can be well handled by the finite element frontend. The governing equation over the domain, Dirichlet, and Neumann boundary conditions are directly enforced on the finite element frontend. Thus, losses of boundary conditions in PINN are rendered unnecessary. The overfitting problem in DEM is also significantly mitigated. Fully connected neural network (FCNN), modified FCNN, and graph-convolutional network are tested as backends. NNDFEM circumvents nodal force calculation and matrix assembly in FEM. Functional losses of linear elasticity, finite strain nonlinear elasticity, heat conduction, and flow in porous media are validated. A systematic exploration unveils the role of 3D finite element mesh. For large-scale problems, a multi-fidelity learning strategy is employed. Thus, the three-dimensional case with over three million degrees of freedom trains well in two minutes. Benefiting from the fast inference of the neural network backend, the forward pass is 8,550 times faster than FEM.

Posteriori error neural network: A recovery type posteriori error estimator based on neural network for diffusion problems

Recovery-based Error Estimator for the Natural-Convection Problem Based on Penalized Finite Element Method

Solving High Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Error assessment of an adaptive finite elements—neural networks method for an elliptic parametric PDE

Neural network-augmented differentiable finite element method for boundary value problems

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Adaptive Finite Element Interpolated Neural Networks

Recovery Type a Posteriori Error Estimates for the Conduction Convection Problem

Residual-based a Posteriori Error Estimation for Elliptic Interface Problems Approximated by Immersed Finite Element Methods

Recovery-based a posteriori error estimation for elliptic interface problems based on partially penalized immersed finite element methods

An accurate a posteriori error estimator for semilinear Neumann problem and its applications.

A Hybrid Adaptive Finite Difference Method Powered by a Posteriori Error Estimation Technique.

Adaptive Multilevel Neural Networks for Parametric PDEs with Error Estimation

Neural-Network-Assisted Finite Difference Discretization for Numerical Solution of Partial Differential Equations

A Conservative and Positivity-Preserving Method for Solving Anisotropic Diffusion Equations with Deep Learning

A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations

Recovery Type a Posteriori Error Estimation of an Adaptive Finite Element Method for Cahn–Hilliard Equation

Physics-informed Neural Network Algorithm for Solving Forward and Inverse Problems of Variable-Order Space-Fractional Advection–diffusion Equations

Physics-informed neural networks with parameter asymptotic strategy for learning singularly perturbed convection-dominated problem

A Posteriori Error Control of Approximate Solutions to Boundary Value Problems Found by Neural Networks

A posteriori error estimate for stabilized finite element methods for the stokes equations