Abstract:Motivated by the analysis of genetical genomic data, we consider the problem of estimating high-dimensional sparse precision matrix adjusting for possibly a large number of covariates, where the covariates can affect the mean value of the random vector. We develop a two-stage estimation procedure to first identify the relevant covariates that affect the means by a joint ℓ1 penalization. The estimated regression coefficients are then used to estimate the mean values in a multivariate sub-Gaussian model in order to estimate the sparse precision matrix through a ℓ1-penalized log-determinant Bregman divergence. Under the multivariate normal assumption, the precision matrix has the interpretation of a conditional Gaussian graphical model. We show that under some regularity conditions, the estimates of the regression coefficients are consistent in element-wise ℓ∞ norm, Frobenius norm and also spectral norm even when p≫n and q≫n. We also show that with probability converging to one, the estimate of the precision matrix correctly specifies the zero pattern of the true precision matrix. We illustrate our theoretical results via simulations and demonstrate that the method can lead to improved estimate of the precision matrix. We apply the method to an analysis of a yeast genetical genomic data.

Fast Projected Newton-like Method for Precision Matrix Estimation under Total Positivity

Adaptive Estimation of Graphical Models under Total Positivity

Positive-Definite Sparse Precision Matrix Estimation

An Efficient ADMM Algorithm for High Dimensional Precision Matrix Estimation Via Penalized Quadratic Loss

A Block Coordinate Descent-Based Projected Gradient Algorithm for Orthogonal Non-Negative Matrix Factorization

Fast and Adaptive Sparse Precision Matrix Estimation in High Dimensions

Learning High-dimensional Gaussian Graphical Models under Total Positivity Without Adjustment of Tuning Parameters

Precision and Cholesky Factor Estimation for Gaussian Processes

Distributed Sparse Precision Matrix Estimation via Alternating Block-Based Gradient Descent

A Semismooth Newton-CG Based Dual PPA for Matrix Spectral Norm Approximation Problems

Manifold Gaussian Variational Bayes on the Precision Matrix

Scalable Inference for High-Dimensional Precision Matrix

A fast ADMM algorithm for sparse precision matrix estimation using lasso penalized D-trace loss

An Efficient Nonmonotone Projected Barzilai–Borwein Method for Nonnegative Matrix Factorization with Extrapolation

An Adaptive Nonmonotone Projected Barzilai-Borwein Gradient Method with Active Set Prediction for Nonnegative Matrix Factorization

A new approach for ultrahigh dimensional precision matrix estimation

Joint Estimation Of Multiple High-Dimensional Precision Matrices

Adjusting for high-dimensional covariates in sparse precision matrix estimation by ℓ1-penalization