Abstract:Data in many scientific and engineering applications are structured and contain multiple aspects. There are two significant challenges for predictive modeling for these data. The first challenge is how to model nonlinear relationships between different entities in the data, and the second challenge is how to make scalable inference for predictive models. To address these challenges, we use Gaussian processes to provide data modeling solutions and develop efficient inference algorithms by exploiting the structures within the data. First, we present a sparse Gaussian process regression method, GPLasso, which uses KL divergence minimization and &ell;1 penalization to explicitly represent the tradeoff between accuracy and sparsity. GPLasso beats the state-of-the-art methods on both predictive performance and speed. Second, we propose network models based on matrix-variate Gaussian processes, which generalize the popular bilinear models to nonlinear factorization models in infinite feature spaces. Experiments on both synthetic and real-world networks demonstrate that our models have superior link prediction and community discovery performance. Last, we propose to generalize the matrix-variate Gaussian processes to tensors and apply them to nonlinear tensor factorization. Our nonlinear tensor factorization models—InfTucker—can be regarded as the classic Tucker decomposition in infinite feature spaces. In our experiments on chemometrics and social network datasets, our new models achieve significantly higher prediction accuracy than the state-of-the-art tensor decomposition approaches.

Gaussian Graphical Models parallel estimation via coordinate descent neighborhood selection

Multiple Gaussian Graphical Estimation with Jointly Sparse Penalty

Learning Latent Variable Gaussian Graphical Models

DC Algorithm for Estimation of Sparse Gaussian Graphical Models

High-Dimensional Joint Estimation of Multiple Directed Gaussian Graphical Models

Efficient Learning Algorithms for Gaussian Processes

An Asymptotically Optimal Coordinate Descent Algorithm for Learning Bayesian Networks from Gaussian Models

The Cluster Graphical Lasso for improved estimation of Gaussian graphical models

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

Fast and scalable learning of sparse changes in high-dimensional graphical model structure

Partial Gaussian Graphical Model Estimation

High-dimensional Functional Graphical Model Structure Learning via Neighborhood Selection Approach

Simultaneous Identification of Sparse Structures and Communities in Heterogeneous Graphical Models

Efficient Neighborhood Selection for Gaussian Graphical Models

Representing Additive Gaussian Processes by Sparse Matrices

Penalized Maximum Likelihood Estimation of Multi-layered Gaussian Graphical Models

Exploration of the search space of Gaussian graphical models for paired data

Global structure-guided neighborhood preserving embedding for dimensionality reduction

High-Dimensional Gaussian Graphical Regression Models with Covariates

Algorithm xxx: A Covariate-Dependent Approach to Gaussian Graphical Modeling in R

EigenGP: Gaussian Processes with Sparse Data-Dependent Eigenfunctions