Abstract:Classical numerical methods such as finite element method (FEM) face limitations due to their low efficiency when addressing large-scale problems. As a novel paradigm, the physics-informed neural network (PINN) has demonstrated significant potential to solve partial differential equations. However, conventional PINNs utilize meshless control at discrete sampling points, which limits their ability to effectively handle complex boundaries. Moreover, catastrophic failure may occur in the deep energy method (DEM, a specific type of PINN). To handle these challenges, this study proposes a Neural Network-augmented Differentiable Finite Element Method (NNDFEM) by combining PINN and finite element approximation. In NNDFEM, the neural network backend solely predicts nodal variables. Derivatives and complex boundary conditions can be well handled by the finite element frontend. The governing equation over the domain, Dirichlet, and Neumann boundary conditions are directly enforced on the finite element frontend. Thus, losses of boundary conditions in PINN are rendered unnecessary. The overfitting problem in DEM is also significantly mitigated. Fully connected neural network (FCNN), modified FCNN, and graph-convolutional network are tested as backends. NNDFEM circumvents nodal force calculation and matrix assembly in FEM. Functional losses of linear elasticity, finite strain nonlinear elasticity, heat conduction, and flow in porous media are validated. A systematic exploration unveils the role of 3D finite element mesh. For large-scale problems, a multi-fidelity learning strategy is employed. Thus, the three-dimensional case with over three million degrees of freedom trains well in two minutes. Benefiting from the fast inference of the neural network backend, the forward pass is 8,550 times faster than FEM.

The Equivalence and Realization of Neural Network and Finite Differences Time Domain

An End-to-End Neural Network for Complex Electromagnetic Simulations

Modeling method of finite-difference time-domain based on frequency network models of active devices

Study on a Recurrent Convolutional Neural Network Based FDTD Method

A new method based on machine learning for the FDTD method

Electromagnetic Modeling Using an FDTD-Equivalent Recurrent Convolution Neural Network: Accurate Computing on a Deep Learning Framework.

TFDMNet: A Novel Network Structure Combines the Time Domain and Frequency Domain Features

Convergence Enhancement for Neural Network Integrated Power System Time Domain Simulation

Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations

Finite-Time Analysis of Adaptive Temporal Difference Learning with Deep Neural Networks

Fast Solver of 2D Maxwell's Equations Based on Fourier Neural Operator

Study on Transformer-CNN based FDTD Method

Finite difference-embedded UNet for solving transcranial ultrasound frequency-domain wavefield

Differentiable-Decision-Tree-Based Neural Turing Machine Model Integrated Into FDTD for Implementing EM Problems

Enhancing Convolutional Neural Networks with Higher-Order Numerical Difference Methods

Neural network-augmented differentiable finite element method for boundary value problems

A New Efficient Fdtd Time-To-Frequency-Domain Conversion Algorithm

Two-Dimensional Electromagnetic Solver Based on Deep Learning Technique

Finite volume method network for acceleration of unsteady computational fluid dynamics: non-reacting and reacting flows

Finite Difference Neural Networks: Fast Prediction of Partial Differential Equations

Cambricon-D: Full-Network Differential Acceleration for Diffusion Models