Abstract:Neural operators, as a powerful approximation to the non-linear operators between infinite-dimensional function spaces, have proved to be promising in accelerating the solution of partial differential equations (PDE). However, it requires a large amount of simulated data, which can be costly to collect. This can be avoided by learning physics from the physics-constrained loss, which we refer to it as mean squared residual (MSR) loss constructed by the discretized PDE. We investigate the physical information in the MSR loss, which we called long-range entanglements, and identify the challenge that the neural network requires the capacity to model the long-range entanglements in the spatial domain of the PDE, whose patterns vary in different PDEs. To tackle the challenge, we propose LordNet, a tunable and efficient neural network for modeling various entanglements. Inspired by the traditional solvers, LordNet models the long-range entanglements with a series of matrix multiplications, which can be seen as the low-rank approximation to the general fully-connected layers and extracts the dominant pattern with reduced computational cost. The experiments on solving Poisson's equation and (2D and 3D) Navier-Stokes equation demonstrate that the long-range entanglements from the MSR loss can be well modeled by the LordNet, yielding better accuracy and generalization ability than other neural networks. The results show that the Lordnet can be $50\times$ faster than traditional PDE solvers. In addition, LordNet outperforms other modern neural network architectures in accuracy and efficiency with the smallest parameter size.

Study on a Fast Solver for Poisson’s Equation Based on Deep Learning Technique

Study on a Poisson's Equation Solver Based on Deep Learning Technique.

An End-to-End Neural Network for Complex Electromagnetic Simulations

Study on a 3D Possion's Equation Slover Based on Deep Learning Technique

Solving Poisson's Equation using Deep Learning in Particle Simulation of PN Junction

Fast Full-Wave Electromagnetic Forward Solver Based on Deep Conditional Convolutional Autoencoders

Solving Combined Field Integral Equation with Deep Neural Network for 2-D Conducting Object

Fast Solver of 2D Maxwell's Equations Based on Fourier Neural Operator

A Neural Network-Based Poisson Solver for Fluid Simulation

Rapid surrogate modeling of magnetotelluric in the frequency domain using physics-driven deep neural networks

Non-equispaced Fourier Neural Solvers for PDEs

Physics-Informed Neural Networks for Solving 2-D Magnetostatic Fields

A Poisson’s Equation Solver Based on Neural Network Precondtioned CG Method

Learning-Based Fast Electromagnetic Scattering Solver Through Generative Adversarial Network

LordNet: An Efficient Neural Network for Learning to Solve Parametric Partial Differential Equations without Simulated Data

Enriched Physics-informed Neural Networks for Dynamic Poisson-Nernst-Planck Systems

An Efficient Method for Solving Two-Dimensional Partial Differential Equations with the Deep Operator Network

A PNP ion channel deep learning solver with local neural network and finite element input data

Accelerating three-dimensional phase-field simulations via deep learning approaches

Data-driven Discovery of Partial Differential Equations for Multiple-Physics Electromagnetic Problem

A fully differentiable GNN-based PDE Solver: With Applications to Poisson and Navier-Stokes Equations