Abstract:Numerous engineering problems of interest to the industry are often characterized by expensive black-box objective experiments or computer simulations. Obtaining insight into the problem or performing subsequent optimizations requires hundreds of thousands of evaluations of the objective function which is most often a practically unachievable task. Gaussian Process (GP) surrogate modeling replaces the expensive function with a cheap-to-evaluate data-driven probabilistic model. While the GP does not assume a functional form of the problem, it is defined by a set of parameters, called hyperparameters. The hyperparameters define the characteristics of the objective function, such as smoothness, magnitude, periodicity, etc. Accurately estimating these hyperparameters is a key ingredient in developing a reliable and generalizable surrogate model. Markov chain Monte Carlo (MCMC) is a ubiquitously used Bayesian method to estimate these hyperparameters. At the GE Global Research Center, a customized industry-strength Bayesian hybrid modeling framework utilizing the GP, called GEBHM, has been employed and validated over many years. GEBHM is very effective on problems of small and medium size, typically less than 1000 training points. However, the GP does not scale well in time with a growing dataset and problem dimensionality which can be a major impediment in such problems. In this work, we extend and implement in GEBHM an Adaptive Sequential Monte Carlo (ASMC) methodology for training the GP enabling the modeling of large-scale industry problems. This implementation saves computational time (especially for large-scale problems) while not sacrificing predictability over the current MCMC implementation. We demonstrate the effectiveness and accuracy of GEBHM with ASMC on four mathematical problems and on two challenging industry applications of varying complexity.

Scalable, Federated Gaussian Process Training for Decentralized Multi-Agent Systems

Distributed Gaussian Processes Hyperparameter Optimization for Big Data Using Proximal ADMM

Federated Bayesian Neural Regression: A Scalable Global Federated Gaussian Process

Sparsity-Aware Distributed Learning for Gaussian Processes with Linear Multiple Kernel

Scalable Gaussian Process Using Inexact Admm For Big Data

Distributed Online Sparse Gaussian Process Regression for Multi-Agent Coverage Control

Towards Scalable Gaussian Process Modeling

Gaussian Process Regression with Grid Spectral Mixture Kernel: Distributed Learning for Multidimensional Data

Federated Automatic Latent Variable Selection in Multi-output Gaussian Processes

Online Learning of Interaction Dynamics with Dual Model Predictive Control for Multi-Agent Systems Using Gaussian Processes

Collective Online Learning of Gaussian Processes in Massive Multi-Agent Systems

Whom to Trust? Elective Learning for Distributed Gaussian Process Regression

Global Optimization of Gaussian processes

Federated Sparse Gaussian Processes

Gaussian Graphical Models as an Ensemble Method for Distributed Gaussian Processes

Gaussian process decentralized data fusion meets transfer learning in large-scale distributed cooperative perception

Thoughts on Massively Scalable Gaussian Processes

Decentralised Federated Learning with Adaptive Partial Gradient Aggregation

Federated Gaussian Process: Convergence, Automatic Personalization and Multi-fidelity Modeling

Parallel cross-validation: A scalable fitting method for Gaussian process models

Large-Scale Gaussian Processes via Alternating Projection