Learning high frequency data via the coupled frequency predictor-corrector triangular DNN

Rui Zhang
DOI: https://doi.org/10.1007/s13160-023-00577-8
2023-03-27
Japan Journal of Industrial and Applied Mathematics
Abstract:In this paper, we propose a coupled frequency predictor-corrector triangular deep neural network (cFPCT-DNN), which provides an efficient convergence in approximating high-frequency functions. The cFPCT-DNN makes use of the frequency principle (F-principle) that standard deep neural networks (DNNs) often achieve convergence in the low-frequency range first. We use the simple predictor network to obtain the optimal super parameter, then construct the corrector deep neural network using triangular activation function with this optimal parameter. With the help of the optimal parameter, the corrector DNN has endowed the appropriate frequency such that it can learn high-frequency targets. To learn the highly oscillating solutions of the wave equation, the cFPCT-DNN can also be combined with physics informed neural networks (PINNs). As a result, the proposed cFPCT-DNN is able to learn high-frequency data with extraordinary efficiency. Numerical results have demonstrated the ability of cFPCT-DNN in learning the highly oscillating functions and solutions of the Helmholtz equations with high wave numbers.
mathematics, applied
What problem does this paper attempt to address?