Abstract:Numerous engineering problems of interest to the industry are often characterized by expensive black-box objective experiments or computer simulations. Obtaining insight into the problem or performing subsequent optimizations requires hundreds of thousands of evaluations of the objective function which is most often a practically unachievable task. Gaussian Process (GP) surrogate modeling replaces the expensive function with a cheap-to-evaluate data-driven probabilistic model. While the GP does not assume a functional form of the problem, it is defined by a set of parameters, called hyperparameters. The hyperparameters define the characteristics of the objective function, such as smoothness, magnitude, periodicity, etc. Accurately estimating these hyperparameters is a key ingredient in developing a reliable and generalizable surrogate model. Markov chain Monte Carlo (MCMC) is a ubiquitously used Bayesian method to estimate these hyperparameters. At the GE Global Research Center, a customized industry-strength Bayesian hybrid modeling framework utilizing the GP, called GEBHM, has been employed and validated over many years. GEBHM is very effective on problems of small and medium size, typically less than 1000 training points. However, the GP does not scale well in time with a growing dataset and problem dimensionality which can be a major impediment in such problems. In this work, we extend and implement in GEBHM an Adaptive Sequential Monte Carlo (ASMC) methodology for training the GP enabling the modeling of large-scale industry problems. This implementation saves computational time (especially for large-scale problems) while not sacrificing predictability over the current MCMC implementation. We demonstrate the effectiveness and accuracy of GEBHM with ASMC on four mathematical problems and on two challenging industry applications of varying complexity.

An adaptive multi-output Gaussian process surrogate model for large-scale parameter estimation problems

An Adaptive Gaussian Process‐based Method for Efficient Bayesian Experimental Design in Groundwater Contaminant Source Identification Problems

Multiobjective Adaptive Surrogate Modeling‐based Optimization for Parameter Estimation of Large, Complex Geophysical Models

Multi-output Gaussian process prediction for computationally expensive problems with multiple levels of fidelity

Towards Scalable Gaussian Process Modeling

A Dynamic Gaussian Process Surrogate Model Based on the Grasshopper Optimization Algorithm for Non-Probabilistic Reliability Analysis of Complex Structures

Global Sensitivity Analysis for Multivariate Outputs Based on Multiple Response Gaussian Process Model

An Adaptive Gaussian Process-Based Iterative Ensemble Smoother for Data Assimilation

A two-stage adaptive multi-fidelity surrogate model-assisted multi-objective genetic algorithm for computationally expensive problems

Adaptive Gaussian Process Regression for Efficient Building of Surrogate Models in Inverse Problems

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

Uncertainty Propagation of Frequency Response Functions Using a Multi-Output Gaussian Process Model

An adaptive Gaussian process method for multi-modal Bayesian inverse problems

A Gaussian Process-Based Dynamic Surrogate Model for Complex Engineering Structural Reliability Analysis

The Study and Application of Gaussian Process Surrogate Model Based on Gradient Particle Swarm Optimized Hyper-Parameters

Multiobjective global surrogate modeling, dealing with the 5-percent problem

Multivariate Adaptive Regression Splines Application for Multivariate Geotechnical Problems with Big Data

Global Optimization Method Using Adaptive and Parallel Ensemble of Surrogates for Engineering Design Optimization

AMFGP: an Active Learning Reliability Analysis Method Based on Multi-Fidelity Gaussian Process Surrogate Model

An Evaluation of Adaptive Surrogate Modeling Based Optimization with Two Benchmark Problems

On-the-fly construction of surrogate constitutive models for concurrent multiscale mechanical analysis through probabilistic machine learning