Abstract:Abstract Scientific and engineering problems often require the use of artificial intelligence to aid understanding and the search for promising designs. While Gaussian processes (GP) stand out as easy-to-use and interpretable learners, they have difficulties in accommodating big data sets, categorical inputs, and multiple responses, which has become a common challenge for a growing number of data-driven design applications. In this paper, we propose a GP model that utilizes latent variables and functions obtained through variational inference to address the aforementioned challenges simultaneously. The method is built upon the latent-variable Gaussian process (LVGP) model where categorical factors are mapped into a continuous latent space to enable GP modeling of mixed-variable data sets. By extending variational inference to LVGP models, the large training data set is replaced by a small set of inducing points to address the scalability issue. Output response vectors are represented by a linear combination of independent latent functions, forming a flexible kernel structure to handle multiple responses that might have distinct behaviors. Comparative studies demonstrate that the proposed method scales well for large data sets with over 104 data points, while outperforming state-of-the-art machine learning methods without requiring much hyperparameter tuning. In addition, an interpretable latent space is obtained to draw insights into the effect of categorical factors, such as those associated with “building blocks” of architectures and element choices in metamaterial and materials design. Our approach is demonstrated for machine learning of ternary oxide materials and topology optimization of a multiscale compliant mechanism with aperiodic microstructures and multiple materials.

Generative Classification Model for Categorical Data Based on Latent Gaussian Process.

Latent Gaussian process for anomaly detection in categorical data

Anomaly Detection For Categorical Observations Using Latent Gaussian Process

Multivariate Categorical Data Distribution Estimation Based on Deep Gaussian Process

A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data

Scalable Gaussian Processes for Data-Driven Design Using Big Data With Categorical Factors

Latent Gaussian-Multinomial Generative Model for Annotated Data.

Latent Gaussian Process Regression

Mixed Likelihood Gaussian Process Latent Variable Model

Supervised Gaussian process latent variable model for dimensionality reduction.

Latent Gaussian Models for Topic Modeling

Diffusing Gaussian Mixtures for Generating Categorical Data

Variational Mixtures of Gaussian Processes for Classification.

A Tensor-Variate Gaussian Process for Classification of Multidimensional Structured Data

Large-margin multi-view Gaussian process

Scalable Gaussian Process Classification with Additive Noise for Non-Gaussian Likelihoods

Mixed and missing data: a unified treatment with latent graphical models

Large-margin multi-view Gaussian process for image classification

A Hybrid of Generative and Discriminative Models Based on the Gaussian-coupled Softmax Layer

A Generative Probabilistic Model for Multi-label Classification