Abstract:Data in many scientific and engineering applications are structured and contain multiple aspects. There are two significant challenges for predictive modeling for these data. The first challenge is how to model nonlinear relationships between different entities in the data, and the second challenge is how to make scalable inference for predictive models. To address these challenges, we use Gaussian processes to provide data modeling solutions and develop efficient inference algorithms by exploiting the structures within the data. First, we present a sparse Gaussian process regression method, GPLasso, which uses KL divergence minimization and &ell;1 penalization to explicitly represent the tradeoff between accuracy and sparsity. GPLasso beats the state-of-the-art methods on both predictive performance and speed. Second, we propose network models based on matrix-variate Gaussian processes, which generalize the popular bilinear models to nonlinear factorization models in infinite feature spaces. Experiments on both synthetic and real-world networks demonstrate that our models have superior link prediction and community discovery performance. Last, we propose to generalize the matrix-variate Gaussian processes to tensors and apply them to nonlinear tensor factorization. Our nonlinear tensor factorization models—InfTucker—can be regarded as the classic Tucker decomposition in infinite feature spaces. In our experiments on chemometrics and social network datasets, our new models achieve significantly higher prediction accuracy than the state-of-the-art tensor decomposition approaches.

Composite Inference for Gaussian Processes

Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-Fidelity Simulations

Optimal Composite Likelihood Estimation and Prediction for Distributed Gaussian Process Modeling.

Composite Gaussian Processes: Scalable Computation and Performance Analysis

Mixture Gaussian Process Model with Gaussian Mixture Distribution for Big Data

Efficient Learning Algorithms for Gaussian Processes

Scalable Gaussian Process Using Inexact Admm For Big Data

Block Vecchia Approximation for Scalable and Efficient Gaussian Process Computations

Inference and Prediction in Big Data Using Sparse Gaussian Process Method

H-GPR: A HYBRID STRATEGY FOR LARGE-SCALE GAUSSIAN PROCESS REGRESSION

Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Generalized Local Aggregation for Large Scale Gaussian Process Regression

Scalable Training of Inference Networks for Gaussian-Process Models.

Mixture of Gaussian Processes and its Applications

Scalable Variational Gaussian Process Regression Networks

Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasets

Hierarchical Mixture-of-Experts Model for Large-Scale Gaussian Process Regression

Fusion of Gaussian Processes Predictions with Monte Carlo Sampling

Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice

Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo

Infinite-Horizon Gaussian Processes