Abstract:Multi-fidelity surrogate models combining dimensionality reduction and an intermediate surrogate in the reduced space allow a cost-effective emulation of simulators with functional outputs. The surrogate is an input-output mapping learned from a limited number of simulator evaluations. This computational efficiency makes surrogates commonly used for many-query tasks. Diverse methods for building them have been proposed in the literature, but they have only been partially compared. This paper introduces a unified framework encompassing the different surrogate families, followed by a methodological comparison and the exposition of practical considerations. More than a dozen of existing multi-fidelity surrogates have been implemented under the unified framework and evaluated on a set of benchmark problems. Based on the results, guidelines and recommendations are proposed regarding multi-fidelity surrogates with functional outputs. Our study shows that most multi-fidelity surrogates outperform their tested single-fidelity counterparts under the considered settings. But no particular surrogate is performing better on every test case. Therefore, the selection of a surrogate should consider the specific properties of the emulated functions, in particular the correlation between the low- and high-fidelity simulators, the size of the training set, the local nonlinear variations in the residual fields, and the size of the training datasets.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively construct surrogate models capable of predicting functional outputs in multi - fidelity simulators. Specifically, the paper focuses on combining dimension - reduction techniques and intermediate surrogate - modeling techniques to create multi - fidelity surrogate models that can accurately predict the functional outputs of complex simulators at a lower computational cost. Since single - fidelity surrogate models have limitations when dealing with high - dimensional functional outputs, and multi - fidelity surrogate models can improve prediction accuracy and efficiency by using data of different fidelities, the paper aims to provide a unified framework to systematically compare existing multi - fidelity surrogate models and propose guidelines for selecting appropriate surrogate models based on benchmarking results. The main contributions of the paper include: 1. **Proposing a unified framework**: The paper proposes a unified framework covering different families of multi - fidelity surrogate models, which helps in understanding and comparing different methods. 2. **Methodological comparison**: A detailed methodological comparison of multi - fidelity surrogate models in the existing literature is carried out, analyzing their advantages and disadvantages. 3. **Benchmarking**: More than a dozen existing multi - fidelity surrogate models are implemented and evaluated on a benchmark containing multiple test cases. 4. **Performance analysis and recommendation**: Based on the test results, guidelines and suggestions on how to select appropriate multi - fidelity surrogate models according to specific problem characteristics are provided. The paper specifically points out that most multi - fidelity surrogate models outperform the corresponding single - fidelity surrogate models in the test settings, but no model performs best in all test cases. Therefore, when selecting a surrogate model, specific properties of the simulated function should be considered, such as the correlation between low - and high - fidelity simulators, the size of the training set, and local nonlinear changes in the residual field.

A survey on multi-fidelity surrogates for simulators with functional outputs: unified framework and benchmark

Multi-fidelity reduced-order surrogate modelling

A Single-Fidelity Surrogate Modeling Method Based on Nonlinearity Integrated Multi-Fidelity Surrogate

Sequential Multi-fidelity Surrogate Modeling

A Multi-Fidelity Surrogate Model Based on Moving Least Squares: Fusing Different Fidelity Data for Engineering Design

General multi-fidelity surrogate models: Framework and active learning strategies for efficient rare event simulation

Multi-fidelity Surrogate Model Ensemble Based on Feasible Intervals

Multi-fidelity Surrogate Modeling for Application/Architecture Co-design

A Multi-Fidelity Surrogate Model Based on Support Vector Regression

A Novel Multi-fidelity Surrogate Model with Two-Stage Ensemble

Boosting Engineering Optimization with a Novel Recursive Transfer Bi-Fidelity Surrogate Modeling

Methodology And Challenges Of Surrogate Modelling Methods For Multi-Fidelity Expensive Black-Box Problems

A novel multi-fidelity surrogate modeling framework integrated with sequential sampling criterion for non-hierarchical data

A Radial Basis Function-Based Multi-Fidelity Surrogate Model: Exploring Correlation Between High-Fidelity and Low-Fidelity Models

A Multi-Fidelity Surrogate Model Based on Design Variable Correlations

Multi-Fidelity Residual Neural Processes for Scalable Surrogate Modeling

Active Learning-Assisted Multi-Fidelity Surrogate Modeling Based on Geometric Transformation

A support vector regression-based multi-fidelity surrogate model

A multi-fidelity surrogate model by optimal model selection

Multifidelity Surrogate Models: A New Data Fusion Perspective

Bi-fidelity Surrogate Modeling Via Scaled Correlation Construction and Penalty Minimization