Abstract:Data in many scientific and engineering applications are structured and contain multiple aspects. There are two significant challenges for predictive modeling for these data. The first challenge is how to model nonlinear relationships between different entities in the data, and the second challenge is how to make scalable inference for predictive models. To address these challenges, we use Gaussian processes to provide data modeling solutions and develop efficient inference algorithms by exploiting the structures within the data. First, we present a sparse Gaussian process regression method, GPLasso, which uses KL divergence minimization and &ell;1 penalization to explicitly represent the tradeoff between accuracy and sparsity. GPLasso beats the state-of-the-art methods on both predictive performance and speed. Second, we propose network models based on matrix-variate Gaussian processes, which generalize the popular bilinear models to nonlinear factorization models in infinite feature spaces. Experiments on both synthetic and real-world networks demonstrate that our models have superior link prediction and community discovery performance. Last, we propose to generalize the matrix-variate Gaussian processes to tensors and apply them to nonlinear tensor factorization. Our nonlinear tensor factorization models—InfTucker—can be regarded as the classic Tucker decomposition in infinite feature spaces. In our experiments on chemometrics and social network datasets, our new models achieve significantly higher prediction accuracy than the state-of-the-art tensor decomposition approaches.

Preventing Model Collapse in Gaussian Process Latent Variable Models

Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-Fidelity Simulations

Supervised Latent Linear Gaussian Process Latent Variable Model for Dimensionality Reduction

Bayesian Non-linear Latent Variable Modeling via Random Fourier Features

Latent variable modeling with random features

Spike and Slab Gaussian Process Latent Variable Models

Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling

Variational Inference for Uncertainty on the Inputs of Gaussian Process Models

Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Models

Process Data Analytics Via Probabilistic Latent Variable Models: A Tutorial Review

Scalable GAM using sparse variational Gaussian processes

Learning Latent Variable Gaussian Graphical Models

Efficient Learning Algorithms for Gaussian Processes

Thin Plate Spline Latent Variable Models for Dimensionality Reduction

Weighted-Sum Gaussian Process Latent Variable Models

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

Robust and Scalable Gaussian Process Regression and Its Applications

Latent variable Gaussian process models: A rank‐based analysis and an alternative approach

A Supervised Method For Nonlinear Dimensionality Reduction With Gplvm

Compressing spectral kernels in Gaussian Process: Enhanced generalization and interpretability