Abstract:Gaussian graphical regressions have emerged as a powerful approach for regressing the precision matrix of a Gaussian graphical model on covariates, which, unlike traditional Gaussian graphical models, can help determine how graphs are modulated by high dimensional subject-level covariates, and recover both the population-level and subject-level graphs. To fit the model, a multi-task learning approach {achieves} %has been shown to result in lower error rates compared to node-wise regressions. However, due to the high complexity and dimensionality of the Gaussian graphical regression problem, the important task of statistical inference remains unexplored. We propose a class of debiased estimators based on multi-task learners for statistical inference in Gaussian graphical regressions. We show that debiasing can be performed quickly and separately for the multi-task learners. In a key debiasing step {that estimates} %involving the estimation of the inverse covariance matrix, we propose a novel {projection technique} %diagonalization approach that dramatically reduces computational costs {in optimization} to scale only with the sample size $n$. We show that our debiased estimators enjoy a fast convergence rate and asymptotically follow a normal distribution, enabling valid statistical inference such as constructing confidence intervals and performing hypothesis testing. Simulation studies confirm the practical utility of the proposed approach, and we further apply it to analyze gene co-expression graph data from a brain cancer study, revealing meaningful biological relationships.

Inference in higher-order undirected graphical models and binary polynomial optimization

Inference in Graphical Models via Semidefinite Programming Hierarchies

Pushing the Power of Stochastic Greedy Ordering Schemes for Inference in Graphical Models

Efficient Exact Inference in Planar Ising Models

Tighter Linear Program Relaxations for High Order Graphical Models

Integer Programming on the Junction Tree Polytope for Influence Diagrams

Incremental Inference on Higher-Order Probabilistic Graphical Models Applied to Constraint Satisfaction Problems

Inference for Heterogeneous Graphical Models using Doubly High-Dimensional Linear-Mixed Models

Discrete graphical models -- an optimization perspective

Revisiting Algebra and Complexity of Inference in Graphical Models

A Knowledge Compilation Take on Binary Polynomial Optimization

Joint Inference of Multiple Graphs from Matrix Polynomials

Weighted Positive Binary Decision Diagrams for Exact Probabilistic Inference

Advances in Bayesian Network Learning using Integer Programming

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

Discrete parametric graphical models with Dirichlet type priors

Unfolding Projection-free SDP Relaxation of Binary Graph Classifier via GDPA Linearization

Binary Optimization via Mathematical Programming with Equilibrium Constraints

Statistical Inference for High-Dimensional Generalized Linear Models With Binary Outcomes

Multivariate Bernoulli distribution

Efficient Message Passing for 0-1 ILPs with Binary Decision Diagrams