Abstract:Abstract Scientific and engineering problems often require an inexpensive surrogate model to aid understanding and the search for promising designs. While Gaussian processes (GP) stand out as easy-to-use and interpretable learners in surrogate modeling, they have difficulties in accommodating big datasets, qualitative inputs, and multi-type responses obtained from different simulators, which has become a common challenge for a growing number of data-driven design applications. In this paper, we propose a GP model that utilizes latent variables and functions obtained through variational inference to address the aforementioned challenges simultaneously. The method is built upon the latent variable Gaussian process (LVGP) model where qualitative factors are mapped into a continuous latent space to enable GP modeling of mixed-variable datasets. By extending variational inference to LVGP models, the large training dataset is replaced by a small set of inducing points to address the scalability issue. Output response vectors are represented by a linear combination of independent latent functions, forming a flexible kernel structure to handle multi-type responses. Comparative studies demonstrate that the proposed method scales well for large datasets with over 104 data points, while outperforming state-of-the-art machine learning methods without requiring much hyperparameter tuning. In addition, an interpretable latent space is obtained to draw insights into the effect of qualitative factors, such as those associated with “building blocks” of architectures and element choices in metamaterial and materials design. Our approach is demonstrated for machine learning of ternary oxide materials and topology optimization of a multiscale compliant mechanism with aperiodic microstructures and multiple materials.

Deep Learning Gaussian Processes For Computer Models with Heteroskedastic and High-Dimensional Outputs

Infinite-Horizon Gaussian Processes

A Variant of Gaussian Process Dynamical Systems.

How Deep Are Deep Gaussian Processes?

Likelihood-Free Inference with Deep Gaussian Processes

Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems

Thin and Deep Gaussian Processes

Deep Gaussian Processes with Importance-Weighted Variational Inference

Deep Gaussian Process Emulation and Uncertainty Quantification for Large Computer Experiments

Scalable Gaussian Processes for Data-Driven Design Using Big Data With Categorical Factors

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

Hierarchical Shrinkage Gaussian Processes: Applications to Computer Code Emulation and Dynamical System Recovery

Scaling Gaussian Process Regression with Derivatives

Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations

A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data

Gaussian Process Emulation for High-Dimensional Coupled Systems

Reinforcement Learning via Gaussian Processes with Neural Network Dual Kernels

Prediction with Approximated Gaussian Process Dynamical Models

Latent Gaussian Process Regression

Data-Driven Design via Scalable Gaussian Processes for Multi-Response Big Data With Qualitative Factors