Abstract:Uncertainty propagation in complex engineering systems often poses significant computational challenges related to modeling and quantifying probability distributions of model outputs, as those emerge as the result of various sources of uncertainty that are inherent in the system under investigation. Gaussian Processes regression (GPs) is a robust meta-modeling technique that allows for fast model prediction and exploration of response surfaces. Multi-fidelity variations of GPs further leverage information from cheap and low fidelity model simulations in order to improve their predictive performance on the high fidelity model. In order to cope with the high volume of data required to train GPs in high dimensional design spaces, a common practice is to introduce latent design variables that are typically projections of the original input space to a lower dimensional subspace, and therefore substitute the problem of learning the initial high dimensional mapping, with that of training a GP on a low dimensional space. In this paper, we present a Bayesian approach to identify optimal transformations that map the input points to low dimensional latent variables. The “projection” mapping consists of an orthonormal matrix that is considered a priori unknown and needs to be inferred jointly with the GP parameters, conditioned on the available training data. The proposed Bayesian inference scheme relies on a two-step iterative algorithm that samples from the marginal posteriors of the GP parameters and the projection matrix respectively, both using Markov Chain Monte Carlo (MCMC) sampling. In order to take into account the orthogonality constraints imposed on the orthonormal projection matrix, a Geodesic Monte Carlo sampling algorithm is employed, that is suitable for exploiting probability measures on manifolds. We extend the proposed framework to multi-fidelity models using GPs including the scenarios of training multiple outputs together. We validate our framework on three synthetic problems with a known lower-dimensional subspace. The benefits of our proposed framework, are illustrated on the computationally challenging aerodynamic optimization of a last-stage blade for an industrial gas turbine, where we study the effect of an 85-dimensional shape parameterization of a three-dimensional airfoil on two output quantities of interest, specifically on the aerodynamic efficiency and the degree of reaction.

Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-Fidelity Simulations

A Graphical Multi-Fidelity Gaussian Process Model, with Application to Emulation of Heavy-Ion Collisions

Multi-fidelity Gaussian process surrogate modeling for regression problems in physics

Cope with diverse data structures in multi-fidelity modeling: A Gaussian process method.

Conglomerate Multi-fidelity Gaussian Process Modeling, with Application to Heavy-Ion Collisions

Deep Gaussian Process Emulation and Uncertainty Quantification for Large Computer Experiments

Gaussian Process Emulation for High-Dimensional Coupled Systems

A Generalized Multi-Fidelity Simulation Method Using Sparse Polynomial Chaos Expansion

Multi-fidelity data fusion for the approximation of scalar functions with low intrinsic dimensionality through active subspaces

Dimensionality Reduction for Multi-Fidelity Gaussian Processes Using Bayesian Adaptation

Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Computer emulation with non-stationary Gaussian processes

Fast multi-fidelity gaussian processes with derivatives for complex system modeling

Bayesian Learning of Orthogonal Embeddings for Multi-Fidelity Gaussian Processes

Multi-fidelity Hierarchical Neural Processes

Gaussian process modeling for stochastic multi-fidelity simulators, with application to fire safety

A Framework for Controlling Sources of Inaccuracy in Gaussian Process Emulation of Deterministic Computer Experiments

A Multi-Output Multi-Fidelity Gaussian Process Model for Non-Hierarchical Low-Fidelity Data Fusion

Hierarchical Shrinkage Gaussian Processes: Applications to Computer Code Emulation and Dynamical System Recovery

Graph Laplacian-based Bayesian Multi-fidelity Modeling

A Screening-Based Gradient-Enhanced Gaussian Process Regression Model for Multi-Fidelity Data Fusion