Surrogate modelling and uncertainty quantification based on multi-fidelity deep neural network

Zhihui Li,Francesco Montomoli
DOI: https://doi.org/10.1016/j.ress.2024.109975
2023-08-03
Abstract:To reduce training costs, several Deep neural networks (DNNs) that can learn from a small set of HF data and a sufficient number of low-fidelity (LF) data have been proposed. In these established neural networks, a parallel structure is commonly proposed to separately approximate the non-linear and linear correlation between the HF- and LF data. In this paper, a new architecture of multi-fidelity deep neural network (MF-DNN) was proposed where one subnetwork was built to approximate both the non-linear and linear correlation simultaneously. Rather than manually allocating the output weights for the paralleled linear and nonlinear correction networks, the proposed MF-DNN can autonomously learn arbitrary correlation. The prediction accuracy of the proposed MF-DNN was firstly demonstrated by approximating the 1-, 32- and 100-dimensional benchmark functions with either the linear or non-linear correlation. The surrogating modelling results revealed that MF-DNN exhibited excellent approximation capabilities for the test functions. Subsequently, the MF DNN was deployed to simulate the 1-, 32- and 100-dimensional aleatory uncertainty propagation progress with the influence of either the uniform or Gaussian distributions of input uncertainties. The uncertainty quantification (UQ) results validated that the MF-DNN efficiently predicted the probability density distributions of quantities of interest (QoI) as well as the statistical moments without significant compromise of accuracy. MF-DNN was also deployed to model the physical flow of turbine vane LS89. The distributions of isentropic Mach number were well-predicted by MF-DNN based on the 2D Euler flow field and few experimental measurement data points. The proposed MF-DNN should be promising in solving UQ and robust optimization problems in practical engineering applications with multi-fidelity data sources.
Computational Physics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in engineering applications, the acquisition cost of high - fidelity (HF) data is high and the quantity is limited, which restricts the application of deep neural networks (DNN) in practical engineering, especially in high - dimensional uncertainty quantification (UQ) problems. In order to reduce the dependence on high - fidelity data, this paper proposes a new multi - fidelity deep neural network (MF - DNN) architecture. This architecture can simultaneously approximate the linear and nonlinear correlations between high - fidelity and low - fidelity (LF) data without manually assigning the output weights of the linear and nonlinear correction networks. In this way, MF - DNN can independently learn any correlation and reduce the training cost while maintaining the prediction accuracy. Specifically, the main objectives of the paper include: 1. **Develop a new MF - DNN architecture**: This architecture uses only one sub - network to simultaneously approximate the linear and nonlinear correlations between high - fidelity and low - fidelity data, avoiding the problem of manually assigning weights in existing methods. 2. **Verify the prediction ability of MF - DNN**: Evaluate the approximation ability and uncertainty quantification performance of MF - DNN through a series of benchmark test functions (1 - dimensional, 32 - dimensional and 100 - dimensional). 3. **Apply to practical engineering problems**: Apply MF - DNN to the physical flow field modeling of the turbine blade LS89 to verify its effectiveness and accuracy in practical engineering problems. Through these objectives, the paper shows the potential of MF - DNN in dealing with the uncertainty and optimization problems of multi - fidelity data sources, especially in high - dimensional problems.