Abstract:Despite the widespread utilization of Gaussian process models for versatile nonparametric modeling, they exhibit limitations in effectively capturing abrupt changes in function smoothness and accommodating relationships with heteroscedastic errors. Addressing these shortcomings, the heteroscedastic Gaussian process (HeGP) regression seeks to introduce flexibility by acknowledging the variability of residual variances across covariates in the regression model. In this work, we extend the HeGP concept, expanding its scope beyond regression tasks to encompass classification and state-space models. To achieve this, we propose a novel framework where the Gaussian process is coupled with a covariate-induced precision matrix process, adopting a mixture formulation. This approach enables the modeling of heteroscedastic covariance functions across covariates. To mitigate the computational challenges posed by sampling, we employ variational inference to approximate the posterior and facilitate posterior predictive modeling. Additionally, our training process leverages an EM algorithm featuring closed-form M-step updates to efficiently evaluate the heteroscedastic covariance function. A notable feature of our model is its consistent performance on multivariate responses, accommodating various types (continuous or categorical) seamlessly. Through a combination of simulations and real-world applications in climatology, we illustrate the model's prowess and advantages. By overcoming the limitations of traditional Gaussian process models, our proposed framework offers a robust and versatile tool for a wide array of applications.

Nowcasting with mixed frequency data using Gaussian processes

Dynamic Mixed Frequency Synthesis for Economic Nowcasting

Nowcasting China's GDP Using a Bayesian Approach

Gaussian Process Nowcasting: Application to COVID-19 Mortality Reporting

Reservoir Computing for Macroeconomic Forecasting with Mixed Frequency Data

Nowcasting Growth using Google Trends Data: A Bayesian Structural Time Series Model

Nowcasting monthly GDP with big data: A model averaging approach

When are Google data useful to nowcast GDP? An approach via pre-selection and shrinkage

Spatiotemporal clustering using Gaussian processes embedded in a mixture model

Nowcasting GDP using machine learning methods

Nowcasting with signature methods

Infinite-Horizon Gaussian Processes

Generating density nowcasts for U.S. GDP growth with deep learning: Bayes by Backprop and Monte Carlo dropout

Mixed-Stationary Gaussian Process for Flexible Non-Stationary Modeling of Spatial Outcomes

Nowcasting the Portuguese GDP with Monthly Data

Exploring Multisource High‐Dimensional Mixed‐Frequency Risks in the Stock Market: A Group Penalized Reverse Unrestricted Mixed Data Sampling Approach

DMIDAS: Deep Mixed Data Sampling Regression for Long Multi-Horizon Time Series Forecasting

Amortized Bayesian Local Interpolation NetworK: Fast covariance parameter estimation for Gaussian Processes

Multi-Response Heteroscedastic Gaussian Process Models and Their Inference

Dimensionality Reduction for Multi-Fidelity Gaussian Processes Using Bayesian Adaptation

Nonparametric Bayesian Mixed-effect Model: a Sparse Gaussian Process Approach