Abstract:Logistic regression is key method for modeling the probability of a binary outcome based on a collection of covariates. However, the classical formulation of logistic regression relies on the independent sampling assumption, which is often violated when the outcomes interact through an underlying network structure, such as over a temporal/spatial domain or on a social network. This necessitates the development of models that can simultaneously handle both the network `peer-effect' and the effect of high-dimensional covariates. In this paper, we develop a framework for incorporating such dependencies in a high-dimensional logistic regression model by introducing a quadratic interaction term, as in the Ising model, designed to capture the pairwise interactions from the underlying network. The resulting model can also be viewed as an Ising model, where the node-dependent external fields linearly encode the high-dimensional covariates. We propose a penalized maximum pseudo-likelihood method for estimating the network peer-effect and the effect of the covariates (the regression coefficients), which, in addition to handling the high-dimensionality of the parameters, conveniently avoids the computational intractability of the maximum likelihood approach. Under various standard regularity conditions, we show that the corresponding estimate attains the classical high-dimensional rate of consistency. Our results imply that even under network dependence it is possible to consistently estimate the model parameters at the same rate as in classical (independent) logistic regression, when the true parameter is sparse and the underlying network is not too dense. We also develop an efficient algorithm for computing the estimates and validate our theoretical results in numerical experiments. An application to selecting genes in clustering spatial transcriptomics data is also discussed.

Variable Selection for High-dimensional Nodal Attributes in Social Networks with Degree Heterogeneity

Scalable Bayesian variable selection for structured high‐dimensional data

Optimal Network Membership Estimation under Severe Degree Heterogeneity

Differential privacy statistical inference for a directed graph network model with covariates

Inference in semiparametric formation models for directed networks

Non-asymptotic model selection for models of network data with parameter vectors of increasing dimension

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

Bayesian variable selection in linear regression models with instrumental variables

Neighborhood selection with application to social networks

Stratified Stochastic Variational Inference for High-Dimensional Network Factor Model

A modeling framework for detecting and leveraging node-level information in Bayesian network inference

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

Bayesian graph selection consistency under model misspecification

High Dimensional Logistic Regression Under Network Dependence

Inference for Heterogeneous Graphical Models using Doubly High-Dimensional Linear-Mixed Models

A degree-corrected Cox model for dynamic networks

A Popularity Scaled Latent Space Model for Large-Scale Directed Social Network

Variable Selection Using Nonlocal Priors in High-Dimensional Generalized Linear Models With Application to fMRI Data Analysis

Inferring High-Dimensional Dynamic Networks Changing with Multiple Covariates

Network-adjusted covariates for community detection