Abstract:In recent years, a significant amount of attention has been paid to solve partial differential equations (PDEs) by deep learning. For example, deep Galerkin method (DGM) uses the PDE residual in the least-squares sense as the loss function and a deep neural network (DNN) to approximate the PDE solution. In this work, we propose a deep mixed residual method (MIM) to solve PDEs with high-order derivatives. Notable examples include Poisson equation, Monge-Ampére equation, biharmonic equation, and Korteweg-de Vries equation. In MIM, we first rewrite a high-order PDE into a first-order system, very much in the same spirit as local discontinuous Galerkin method and mixed finite element method in classical numerical methods for PDEs. We then use the residual of the first-order system in the least-squares sense as the loss function, which is in close connection with least-squares finite element method. For aforementioned classical numerical methods, the choice of trial and test functions is important for stability and accuracy issues in many cases. MIM shares this property when DNNs are employed to approximate unknowns functions in the first-order system. In one case, we use nearly the same DNN to approximate all unknown functions and in the other case, we use totally different DNNs for different unknown functions. Numerous results of MIM with different loss functions and different choices of DNNs are given for four types of PDEs. In most cases, MIM provides better approximations (not only for high-order derivatives of the PDE solution but also for the PDE solution itself) than DGM with nearly the same DNN and the same execution time, sometimes by more than one order of magnitude. MIM with multiple DNNs often provides better approximations than MIM with only one DNN, sometimes by more than one order of magnitude. Numerical results also indicate interesting connections between MIM and classical numerical methods. Therefore, we expect MIM to open up a possibly systematic way to understand and improve deep learning for solving PDEs from the perspective of classical numerical analysis.

Deep Mixed Residual Method for Solving Pde-Constrained Optimization Problems

A Priori Error Estimate of Deep Mixed Residual Method for Elliptic PDEs

R-adaptive DeepONet: Learning Solution Operators for PDEs with Discontinuous Solutions Using an R-adaptive Strategy

Solving forward and inverse PDE problems on unknown manifolds via physics-informed neural operators

Deep Petrov-Galerkin Method for Solving Partial Differential Equations

The ADMM-PINNs Algorithmic Framework for Nonsmooth PDE-Constrained Optimization: A Deep Learning Approach

MRF-PINN: A Multi-Receptive-Field convolutional physics-informed neural network for solving partial differential equations

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

MIM: A deep mixed residual method for solving high-order partial differential equations

Convergence Analysis of a Quasi-Monte Carlo-based Deep Learning Algorithm for Solving Partial Differential Equations

An Efficient Method for Solving Two-Dimensional Partial Differential Equations with the Deep Operator Network

$r-$Adaptive Deep Learning Method for Solving Partial Differential Equations

A Deep Double Ritz Method (D$^2$RM) for solving Partial Differential Equations using Neural Networks

Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradients

Error Analysis of the Deep Mixed Residual Method for High-order Elliptic Equations

Synergistic Learning with Multi-Task DeepONet for Efficient PDE Problem Solving

A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equations

A Review of Neural Network Solvers for Second-order Boundary Value Problems

Deep convolutional Ritz method: parametric PDE surrogates without labeled data