Abstract:Multi-fidelity (MF) methods are gaining popularity for enhancing surrogate modeling and design optimization by incorporating data from various low-fidelity (LF) models. While most existing MF methods assume a fixed dataset, adaptive sampling methods that dynamically allocate resources among fidelity models can achieve higher efficiency in the exploring and exploiting the design space. However, most existing MF methods rely on the hierarchical assumption of fidelity levels or fail to capture the intercorrelation between multiple fidelity levels and utilize it to quantify the value of the future samples and navigate the adaptive sampling. To address this hurdle, we propose a framework hinged on a latent embedding for different fidelity models and the associated pre-posterior analysis to explicitly utilize their correlation for adaptive sampling. In this framework, each infill sampling iteration includes two steps: We first identify the location of interest with the greatest potential improvement using the high-fidelity (HF) model, then we search for the next sample across all fidelity levels that maximize the improvement per unit cost at the location identified in the first step. This is made possible by a single Latent Variable Gaussian Process (LVGP) model that maps different fidelity models into an interpretable latent space to capture their correlations without assuming hierarchical fidelity levels. The LVGP enables us to assess how LF sampling candidates will affect HF response with pre-posterior analysis and determine the next sample with the best benefit-to-cost ratio. Through test cases, we demonstrate that the proposed method outperforms the benchmark methods in both MF global fitting (GF) and Bayesian Optimization (BO) problems in convergence rate and robustness. Moreover, the method offers the flexibility to switch between GF and BO by simply changing the acquisition function.

Active sampling: A machine-learning-assisted framework for finite population inference with optimal subsamples

Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback

Adaptive Informative Sampling for Active Learning.

Learning Distinctive Margin Toward Active Domain Adaptation

Active Diffusion Subsampling

Optimal subsampling designs

A Serial Sample Selection Framework for Active Learning.

Optimal Subsampling via Predictive Inference

Optimal Subsampling Approaches for Large Sample Linear Regression

AdaSelection: Accelerating Deep Learning Training through Data Subsampling

One Backward from Ten Forward, Subsampling for Large-Scale Deep Learning

Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inference

Fairness Without Harm: An Influence-Guided Active Sampling Approach

Accelerating Machine Learning Algorithms with Adaptive Sampling

Adaptive Sampling for Deep Learning via Efficient Nonparametric Proxies

A Latent Variable Approach for Non-Hierarchical Multi-Fidelity Adaptive Sampling

Active Statistical Inference

Subsampling and Jackknifing: A Practically Convenient Solution for Large Data Analysis with Limited Computational Resources

An Adaptive Multi-Fidelity Sampling Framework for Safety Analysis of Connected and Automated Vehicles