Abstract:Numerous engineering problems of interest to the industry are often characterized by expensive black-box objective experiments or computer simulations. Obtaining insight into the problem or performing subsequent optimizations requires hundreds of thousands of evaluations of the objective function which is most often a practically unachievable task. Gaussian Process (GP) surrogate modeling replaces the expensive function with a cheap-to-evaluate data-driven probabilistic model. While the GP does not assume a functional form of the problem, it is defined by a set of parameters, called hyperparameters. The hyperparameters define the characteristics of the objective function, such as smoothness, magnitude, periodicity, etc. Accurately estimating these hyperparameters is a key ingredient in developing a reliable and generalizable surrogate model. Markov chain Monte Carlo (MCMC) is a ubiquitously used Bayesian method to estimate these hyperparameters. At the GE Global Research Center, a customized industry-strength Bayesian hybrid modeling framework utilizing the GP, called GEBHM, has been employed and validated over many years. GEBHM is very effective on problems of small and medium size, typically less than 1000 training points. However, the GP does not scale well in time with a growing dataset and problem dimensionality which can be a major impediment in such problems. In this work, we extend and implement in GEBHM an Adaptive Sequential Monte Carlo (ASMC) methodology for training the GP enabling the modeling of large-scale industry problems. This implementation saves computational time (especially for large-scale problems) while not sacrificing predictability over the current MCMC implementation. We demonstrate the effectiveness and accuracy of GEBHM with ASMC on four mathematical problems and on two challenging industry applications of varying complexity.

EzGP: Easy-to-Interpret Gaussian Process Models for Computer Experiments with Both Quantitative and Qualitative Factors

Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-Fidelity Simulations

Deep Gaussian Process Emulation and Uncertainty Quantification for Large Computer Experiments

Data-Driven Design via Scalable Gaussian Processes for Multi-Response Big Data With Qualitative Factors

Energetic Variational Gaussian Process Regression for Computer Experiments

Computer emulation with non-stationary Gaussian processes

Computer Experiments with Both Qualitative and Quantitative Variables

Category tree Gaussian process for computer experiments with many-category qualitative factors and application to cooling system design

A Framework for Controlling Sources of Inaccuracy in Gaussian Process Emulation of Deterministic Computer Experiments

Mixture of Gaussian Processes and its Applications

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

Deep Q-Exponential Processes

Design and analysis of computer experiments with quantitative and qualitative inputs: A selective review

ANOVA Gaussian process modeling for high-dimensional stochastic computational models

Additive Gaussian process regression for metamodeling in high-dimensional problems

Towards Scalable Gaussian Process Modeling

Gaussian Process Emulation for High-Dimensional Coupled Systems

Remarks for Scaling Up a General Gaussian Process to Model Large Dataset with Sub-models

Industrial Data Modeling with Low-Dimensional Inputs and High-Dimensional Outputs

Modeling and Active Learning for Experiments with Quantitative-Sequence Factors

A Fast and Calibrated Computer Model Emulator: An Empirical Bayes Approach