Abstract:Based on neural network and adaptive subspace approximation method, we propose a new machine learning method for solving partial differential equations. The neural network is adopted to build the basis of the finite dimensional subspace. Then the discrete solution is obtained by using the subspace approximation. Especially, based on the subspace approximation, a posteriori error estimator can be derivated by the hypercircle technique. This a posteriori error estimator can act as the loss function for adaptively refining the parameters of neural network.
What problem does this paper attempt to address?
This paper attempts to solve the problems of accuracy and stability encountered when using neural networks to solve partial differential equations (PDEs). Specifically, the author proposes a new machine - learning method based on the adaptive subspace approximation method, aiming to solve partial differential equations with high accuracy.
### Main problems and solutions
1. **Limitations of existing methods**:
- Existing neural network methods, when solving high - dimensional PDEs, usually rely on Monte Carlo integration or sampling methods, which lead to low convergence rates and difficulty in achieving high accuracy.
- Although the traditional finite element method is effective, it has difficulties in dealing with singularity and interface problems.
2. **Proposed solutions**:
- **Neural network subspace method**: By constructing a neural network as the basis of a finite - dimensional subspace, use subspace approximation to obtain discrete solutions.
- **Adaptive posterior error estimator**: The posterior error estimator derived based on the hyper - circle technique can be used as a loss function to adaptively optimize neural network parameters, thereby improving the accuracy of the solution.
- **Tensor neural network (TNN)**: For high - dimensional problems, a tensor neural network structure is proposed, which enables high - dimensional integration to be converted into one - dimensional integration, so that it can be calculated efficiently and accurately using classical quadrature schemes.
### Specific steps of the method
1. **Constructing the neural network subspace**:
- Define a subspace \( V_{\text{NN}} \) consisting of neural network outputs and use it to approximate the solution of the PDE.
2. **Defining the loss function**:
- Use the Ritz form or other variational forms to construct the loss function, and calculate the integral terms in it by numerical integration methods (such as quadrature formulas).
3. **Training the neural network**:
- By optimizing the discrete loss function, adjust the parameters of the neural network to minimize the error.
4. **Adaptive update**:
- Use the posterior error estimator as a loss function for adaptive training to gradually improve the approximation effect of the neural network.
### Key innovation points
- **High - precision integration**: By using TNN to simplify high - dimensional integration into one - dimensional integration, the "curse of dimensionality" problem in traditional methods is solved.
- **Adaptive optimization**: The introduction of an adaptive error estimator enables the neural network to be continuously optimized during the training process, improving the accuracy and stability of the solution.
- **Applicable to complex problems**: This method is not only applicable to standard PDEs, but also can effectively handle PDEs with singularity or interface problems.
### Summary
This paper proposes an efficient adaptive neural network subspace method by combining the powerful expressive ability of neural networks and the ideas of the finite element method, and successfully solves the problems of accuracy and stability in solving high - dimensional PDEs. This method is not only innovative in theory, but also shows good performance and potential in practical applications.