A hybrid FEM-PINN method for time-dependent partial differential equations

Xiaodong Feng,Haojiong Shangguan,Tao Tang,Xiaoliang Wan,Tao Zhou

2024-09-04

Abstract:In this work, we present a hybrid numerical method for solving evolution partial differential equations (PDEs) by merging the time finite element method with deep neural networks. In contrast to the conventional deep learning-based formulation where the neural network is defined on a spatiotemporal domain, our methodology utilizes finite element basis functions in the time direction where the space-dependent coefficients are defined as the output of a neural network. We then apply the Galerkin or collocation projection in the time direction to obtain a system of PDEs for the space-dependent coefficients which is approximated in the framework of PINN. The advantages of such a hybrid formulation are twofold: statistical errors are avoided for the integral in the time direction, and the neural network's output can be regarded as a set of reduced spatial basis functions. To further alleviate the difficulties from high dimensionality and low regularity, we have developed an adaptive sampling strategy that refines the training set. More specifically, we use an explicit density model to approximate the distribution induced by the PDE residual and then augment the training set with new time-dependent random samples given by the learned density model. The effectiveness and efficiency of our proposed method have been demonstrated through a series of numerical experiments.

Numerical Analysis,Artificial Intelligence

What problem does this paper attempt to address?

The paper attempts to address the following issues: 1. **Improving long-term integration accuracy**: The paper focuses on the problem of rapid error growth in Physics-Informed Neural Networks (PINNs) when solving evolution equations, which limits the application of PINNs in long-term integration. Traditional PINNs methods experience error accumulation in long-term sequence predictions, leading to inaccurate results. 2. **Combining finite element methods with deep learning**: A hybrid Finite Element Method-Physics-Informed Neural Network (FEM-PINN) approach is proposed, which improves the numerical solution of evolution Partial Differential Equations (PDEs) by combining time finite element methods with deep neural networks. This method utilizes finite element basis functions for projection in the time direction and uses neural network outputs as spatial correlation coefficients. 3. **Reducing statistical errors and high-dimensional problems**: By adopting an adaptive sampling strategy, the difficulties brought by high dimensions and low regularity problems are alleviated. Specifically, an explicit density model is used to approximate the distribution induced by the PDE residuals, and new time-dependent random samples are generated based on this model to refine the training set, thereby improving the efficiency and accuracy of the model. In summary, the main goal of this paper is to develop a new hybrid method that can avoid the error accumulation problem of traditional PINNs in long-term integration and effectively handle high-dimensional and complex problems.

A hybrid FEM-PINN method for time-dependent partial differential equations

A High-Efficient Hybrid Physics-Informed Neural Networks Based on Convolutional Neural Network

Hybrid Finite Difference with the Physics-informed Neural Network for solving PDE in complex geometries

Neural network-augmented differentiable finite element method for boundary value problems

A Spatial-Temporally Adaptive PINN Framework for 3D Bi-Ventricular Electrophysiological Simulations and Parameter Inference

Coupled Physics-informed Neural Networks for Inferring Solutions of Partial Differential Equations with Unknown Source Terms

A hybrid physics-informed neural network based multiscale solver as a partial differential equation constrained optimization problem

Phase field smoothing-PINN: A neural network solver for partial differential equations with discontinuous coefficients

Monte Carlo PINNs: deep learning approach for forward and inverse problems involving high dimensional fractional partial differential equations

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Physical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansions

Efficient Discrete Physics-informed Neural Networks for Addressing Evolutionary Partial Differential Equations

Pre-training strategy for solving evolution equations based on physics-informed neural networks

Solving a class of multi-scale elliptic PDEs by means of Fourier-based mixed physics informed neural networks

Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting

Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

Physics-informed Neural Network Algorithm for Solving Forward and Inverse Problems of Variable-Order Space-Fractional Advection–diffusion Equations

Combining physics-informed graph neural network and finite difference for solving forward and inverse spatiotemporal PDEs

MRF-PINN: A Multi-Receptive-Field convolutional physics-informed neural network for solving partial differential equations