Abstract:To reduce training costs, several Deep neural networks (DNNs) that can learn from a small set of HF data and a sufficient number of low-fidelity (LF) data have been proposed. In these established neural networks, a parallel structure is commonly proposed to separately approximate the non-linear and linear correlation between the HF- and LF data. In this paper, a new architecture of multi-fidelity deep neural network (MF-DNN) was proposed where one subnetwork was built to approximate both the non-linear and linear correlation simultaneously. Rather than manually allocating the output weights for the paralleled linear and nonlinear correction networks, the proposed MF-DNN can autonomously learn arbitrary correlation. The prediction accuracy of the proposed MF-DNN was firstly demonstrated by approximating the 1-, 32- and 100-dimensional benchmark functions with either the linear or non-linear correlation. The surrogating modelling results revealed that MF-DNN exhibited excellent approximation capabilities for the test functions. Subsequently, the MF DNN was deployed to simulate the 1-, 32- and 100-dimensional aleatory uncertainty propagation progress with the influence of either the uniform or Gaussian distributions of input uncertainties. The uncertainty quantification (UQ) results validated that the MF-DNN efficiently predicted the probability density distributions of quantities of interest (QoI) as well as the statistical moments without significant compromise of accuracy. MF-DNN was also deployed to model the physical flow of turbine vane LS89. The distributions of isentropic Mach number were well-predicted by MF-DNN based on the 2D Euler flow field and few experimental measurement data points. The proposed MF-DNN should be promising in solving UQ and robust optimization problems in practical engineering applications with multi-fidelity data sources.

A Bayesian neural network approach to Multi-fidelity surrogate modelling

Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-Fidelity Simulations

A Study of Bayesian Neural Network Surrogates for Bayesian Optimization

Multi-fidelity Hierarchical Neural Processes

Multi-fidelity Gaussian process surrogate modeling for regression problems in physics

Residual Multi-Fidelity Neural Network Computing

An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems

Multi-Fidelity Residual Neural Processes for Scalable Surrogate Modeling

Surrogate modelling and uncertainty quantification based on multi-fidelity deep neural network

A new multi-fidelity surrogate modelling method for engineering design based on neural network and transfer learning

Hyperparameter-optimized Multi-fidelity Deep Neural Network model associated with Subset Simulation for structural reliability analysis

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

Multi-fidelity reduced-order surrogate modelling

A comprehensive multi-fidelity surrogate framework based on Gaussian process for datasets with heterogeneous responses

Multi-Fidelity Bayesian Neural Network for Uncertainty Quantification in Transonic Aerodynamic Loads

A Single-Fidelity Surrogate Modeling Method Based on Nonlinearity Integrated Multi-Fidelity Surrogate

Multi-Fidelity Surrogate Based on Single Linear Regression

Bayesian Surrogate Training on Multiple Data Sources: A Hybrid Modeling Strategy

Fusion framework and multimodality for the Laplacian approximation of Bayesian neural networks

Bayesian Surrogate Analysis and Uncertainty Propagation

Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks