Abstract:Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo method, together with the deep neural network, is used to overcome the curse of dimensionality, while classical methods fail. Often, a deep neural network outperforms classical numerical methods in terms of both accuracy and efficiency. In this paper, we propose to use quasi-Monte Carlo sampling, instead of Monte-Carlo method to approximate the loss function. To demonstrate the idea, we conduct numerical experiments in the framework of deep Ritz method proposed by Weinan E and Bing Yu. For the same accuracy requirement, it is observed that quasi-Monte Carlo sampling reduces the size of training data set by more than two orders of magnitude compared to that of MC method. Under some assumptions, we prove that quasi-Monte Carlo sampling together with the deep neural network generates a convergent series with rate proportional to the approximation accuracy of quasi-Monte Carlo method for numerical integration. Numerically the fitted convergence rate is a bit smaller, but the proposed approach always outperforms Monte Carlo method. It is worth mentioning that the convergence analysis is generic whenever a loss function is approximated by the quasi-Monte Carlo method, although observations here are based on deep Ritz method.

Combining Monte Carlo and Tensor-network Methods for Partial Differential Equations via Sketching

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Solving High Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Tensor neural networks for high-dimensional Fokker-Planck equations

Tensor Network Space-Time Spectral Collocation Method for Time Dependent Convection-Diffusion-Reaction Equations

Solving High-dimensional Parametric Elliptic Equation Using Tensor Neural Network

pETNNs: Partial Evolutionary Tensor Neural Networks for Solving Time-dependent Partial Differential Equations

Tensor Network Space-Time Spectral Collocation Method for Time-Dependent Convection–Diffusion–Reaction Equations

Solving High Dimensional Partial Differential Equations Using Tensor Type Discretization and Optimization Process

Re-anchoring Quantum Monte Carlo with Tensor-Train Sketching

Solving high-dimensional Fokker-Planck equation with functional hierarchical tensor

Stochastic methods for solving high-dimensional partial differential equations

Solving Schrödinger Equation Using Tensor Neural Network

Tensor Network Space-Time Spectral Collocation Method for Solving the Nonlinear Convection Diffusion Equation

Solving partial differential equations with sampled neural networks

Solving high-dimensional Kolmogorov backward equations with functional hierarchical tensor operators

Solving high-dimensional Hamilton-Jacobi-Bellman equation with functional hierarchical tensor

Tensor Networks for Solving Realistic Time-independent Boltzmann Neutron Transport Equation

Variational Monte Carlo - Bridging Concepts of Machine Learning and High Dimensional Partial Differential Equations

Quasi-Monte Carlo sampling for machine-learning partial differential equations