Abstract:Despite the widespread utilization of Gaussian process models for versatile nonparametric modeling, they exhibit limitations in effectively capturing abrupt changes in function smoothness and accommodating relationships with heteroscedastic errors. Addressing these shortcomings, the heteroscedastic Gaussian process (HeGP) regression seeks to introduce flexibility by acknowledging the variability of residual variances across covariates in the regression model. In this work, we extend the HeGP concept, expanding its scope beyond regression tasks to encompass classification and state-space models. To achieve this, we propose a novel framework where the Gaussian process is coupled with a covariate-induced precision matrix process, adopting a mixture formulation. This approach enables the modeling of heteroscedastic covariance functions across covariates. To mitigate the computational challenges posed by sampling, we employ variational inference to approximate the posterior and facilitate posterior predictive modeling. Additionally, our training process leverages an EM algorithm featuring closed-form M-step updates to efficiently evaluate the heteroscedastic covariance function. A notable feature of our model is its consistent performance on multivariate responses, accommodating various types (continuous or categorical) seamlessly. Through a combination of simulations and real-world applications in climatology, we illustrate the model's prowess and advantages. By overcoming the limitations of traditional Gaussian process models, our proposed framework offers a robust and versatile tool for a wide array of applications.

A Constrained Semi-parametric Gaussian Process Using Bayesian-Entropy Regression

Bayesian-entropy Gaussian Process for Constrained Metamodeling.

Constrained Gaussian Process for Signal Integrity applications using Variational Inference

Learning Bayesian Networks by Constrained Bayesian Estimation

Sparse Gaussian Process Based on Hat Basis Functions

Prediction Using a Bayesian Heteroscedastic Composite Gaussian Process

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

PDE-constrained Gaussian process surrogate modeling with uncertain data locations

Modeling Function-Valued Processes with Nonseparable and/or Nonstationary Covariance Structure.

A Fast GP Regression Method Using Banded Sparsification of Inverse Covariance

Gaussian Process Regression with Soft Inequality and Monotonicity Constraints

Semi-supervised Gaussian Process Latent Variable Model with Pairwise Constraints

Gaussian Process Regression constrained by Boundary Value Problems

Modelling Function-Valued Processes with Nonseparable Covariance Structure

Information consistency of dependent convolved Gaussian processes regression

Gaussian Processes with Errors in Variables: Theory and Computation

Multi-Response Heteroscedastic Gaussian Process Models and Their Inference

Energetic Variational Gaussian Process Regression for Computer Experiments

Conformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guarantees

On the Inference of Applying Gaussian Process Modeling to a Deterministic Function

Constrained Bayesian Nonparametric Regression for Grain Boundary Energy Predictions