Abstract:We studied the least-squares ReLU neural network (LSNN) method for solving linear advection-reaction equation with discontinuous solution in [Cai, Zhiqiang, Jingshuang Chen, and Min Liu. ``Least-squares ReLU neural network (LSNN) method for linear advection-reaction equation.'' Journal of Computational Physics 443 (2021), 110514]. The method is based on a least-squares formulation and uses a new class of approximating functions: ReLU neural network (NN) functions. A critical and additional component of the LSNN method, differing from other NN-based methods, is the introduction of a properly designed and physics preserved discrete differential operator. In this paper, we study the LSNN method for problems with discontinuity interfaces. First, we show that ReLU NN functions with depth $\lceil \log_2(d+1)\rceil+1$ can approximate any $d$-dimensional step function on a discontinuity interface generated by a vector field as streamlines with any prescribed accuracy. By decomposing the solution into continuous and discontinuous parts, we prove theoretically that discretization error of the LSNN method using ReLU NN functions with depth $\lceil \log_2(d+1)\rceil+1$ is mainly determined by the continuous part of the solution provided that the solution jump is constant. Numerical results for both two- and three-dimensional test problems with various discontinuity interfaces show that the LSNN method with enough layers is accurate and does not exhibit the common Gibbs phenomena along discontinuity interfaces.

Adaptive two-layer ReLU neural network: I. Best least-squares approximation

Adaptive Two-Layer ReLU Neural Network: II. Ritz Approximation to Elliptic PDEs

Self-adaptive deep neural network: Numerical approximation to functions and PDEs

ReLU neural network approximation to piecewise constant functions

A Structure-Guided Gauss-Newton Method for Shallow ReLU Neural Network

Optimal function approximation with ReLU neural networks

Least-Squares ReLU Neural Network (LSNN) Method for Linear Advection-Reaction Equation

Two-layer Networks with the ReLU^k Activation Function: Barron Spaces and Derivative Approximation

Least-Squares Neural Network (LSNN) Method For Linear Advection-Reaction Equation: Discontinuity Interface

A priori generalization error for two-layer ReLU neural network through minimum norm solution

Least-Squares Neural Network (LSNN) Method For Linear Advection-Reaction Equation: Non-constant Jumps

Least-Squares ReLU Neural Network (LSNN) Method for Scalar Nonlinear Hyperbolic Conservation Law

Nonparametric regression using deep neural networks with ReLU activation function

Training a Two Layer ReLU Network Analytically

Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class.

Function Approximation with Randomly Initialized Neural Networks for Approximate Model Reference Adaptive Control

Approximation with Random Shallow ReLU Networks with Applications to Model Reference Adaptive Control

How Implicit Regularization of ReLU Neural Networks Characterizes the Learned Function -- Part I: the 1-D Case of Two Layers with Random First Layer

Optimal Rates of Approximation by Shallow ReLU Neural Networks and Applications to Nonparametric Regression

Optimal rates of approximation by shallow ReLU$^k$ neural networks and applications to nonparametric regression

Deep ReLU networks and high-order finite element methods II: Chebyshev emulation