Abstract:Data in many scientific and engineering applications are structured and contain multiple aspects. There are two significant challenges for predictive modeling for these data. The first challenge is how to model nonlinear relationships between different entities in the data, and the second challenge is how to make scalable inference for predictive models. To address these challenges, we use Gaussian processes to provide data modeling solutions and develop efficient inference algorithms by exploiting the structures within the data. First, we present a sparse Gaussian process regression method, GPLasso, which uses KL divergence minimization and &ell;1 penalization to explicitly represent the tradeoff between accuracy and sparsity. GPLasso beats the state-of-the-art methods on both predictive performance and speed. Second, we propose network models based on matrix-variate Gaussian processes, which generalize the popular bilinear models to nonlinear factorization models in infinite feature spaces. Experiments on both synthetic and real-world networks demonstrate that our models have superior link prediction and community discovery performance. Last, we propose to generalize the matrix-variate Gaussian processes to tensors and apply them to nonlinear tensor factorization. Our nonlinear tensor factorization models—InfTucker—can be regarded as the classic Tucker decomposition in infinite feature spaces. In our experiments on chemometrics and social network datasets, our new models achieve significantly higher prediction accuracy than the state-of-the-art tensor decomposition approaches.

Efficient Neighborhood Selection for Gaussian Graphical Models

Learning Gaussian Networks

False Discovery Rate Control for Gaussian Graphical Models via Neighborhood Screening

Gaussian Graphical Models parallel estimation via coordinate descent neighborhood selection

High-dimensional Functional Graphical Model Structure Learning via Neighborhood Selection Approach

Learning Gaussian Graphical Models via Multiplicative Weights

Clustering Gaussian Graphical Models

Portfolio Selection Via Graph-Aware Gaussian Processes with Generalized Gaussian Likelihood

An empirical Bayes procedure for the selection of Gaussian graphical models

Active Learning Algorithms for Graphical Model Selection

Efficient Learning of Discrete Graphical Models

Simultaneous Change Point Inference and Structure Recovery for High Dimensional Gaussian Graphical Models.

Partial Gaussian Graphical Model Estimation

Two New Algorithms for Maximum Likelihood Estimation of Sparse Covariance Matrices With Applications to Graphical Modeling

Neighborhood selection with application to social networks

Adaptive Variable Clustering in Gaussian Graphical Models.

High-Dimensional Graphical Model Selection Using $\ell_1$-Regularized Logistic Regression

Bayesian graph selection consistency under model misspecification

Efficient Learning Algorithms for Gaussian Processes

Statistical Inference on High Dimensional Gaussian Graphical Regression Models