Abstract:Covariance estimation for high-dimensional datasets is a fundamental problem in modern day statistics with numerous applications. In these high dimensional datasets, the number of variables p is typically larger than the sample size n. A popular way of tackling this challenge is to induce sparsity in the covariance matrix, its inverse or a relevant transformation. In particular, methods inducing sparsity in the Cholesky pa- rameter of the inverse covariance matrix can be useful as they are guaranteed to give a positive definite estimate of the covariance matrix. Also, the estimated sparsity pattern corresponds to a Directed Acyclic Graph (DAG) model for Gaussian data. In recent years, two useful penalized likelihood methods for sparse estimation of this Cholesky parameter (with no restrictions on the sparsity pattern) have been developed. How- ever, these methods either consider a non-convex optimization problem which can lead to convergence issues and singular estimates of the covariance matrix when p > n, or achieve a convex formulation by placing a strict constraint on the conditional variance parameters. In this paper, we propose a new penalized likelihood method for sparse estimation of the inverse covariance Cholesky parameter that aims to overcome some of the shortcomings of current methods, but retains their respective strengths. We ob- tain a jointly convex formulation for our objective function, which leads to convergence guarantees, even when p > n. The approach always leads to a positive definite and symmetric estimator of the covariance matrix. We establish high-dimensional estima- tion and graph selection consistency, and also demonstrate finite sample performance on simulated/real data.

High dimensional sparse covariance estimation via directed acyclic graphs

Learning directed acyclic graphs based on sparsest permutations

Two New Algorithms for Maximum Likelihood Estimation of Sparse Covariance Matrices With Applications to Graphical Modeling

Learning Sparse High-Dimensional Matrix-Valued Graphical Models From Dependent Data

Topology Inference of Directed Graphs by Gaussian Processes with Sparsity Constraints

High-Dimensional Joint Estimation of Multiple Directed Gaussian Graphical Models

Fast and Separable Estimation in High-Dimensional Tensor Gaussian Graphical Models

A convex framework for high-dimensional sparse Cholesky based covariance estimation

Recovering Linear Causal Models with Latent Variables via Cholesky Factorization of Covariance Matrix

DC Algorithm for Estimation of Sparse Gaussian Graphical Models

Skeleton Estimation of Directed Acyclic Graphs Using Partial Least Squares from Correlated Data.

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

High-dimensional Gaussian Graphical Model for Network-Linked Data.

High-Dimensional Poisson DAG Model Learning Using $\ell_1$-Regularized Regression

On Sparse High-Dimensional Graphical Model Learning For Dependent Time Series

Nonlinear Directed Acyclic Graph Estimation Based on the Kernel Partial Correlation Coefficient

Sparse inverse covariance estimation with the graphical lasso

Sparse Directed Acyclic Graphs Incorporating the Covariates

High-Dimensional Undirected Graphical Models for Arbitrary Mixed Data

Efficient Learning of Nonparametric Directed Acyclic Graph with Statistical Guarantee