Abstract:Logistic regression is key method for modeling the probability of a binary outcome based on a collection of covariates. However, the classical formulation of logistic regression relies on the independent sampling assumption, which is often violated when the outcomes interact through an underlying network structure, such as over a temporal/spatial domain or on a social network. This necessitates the development of models that can simultaneously handle both the network `peer-effect' and the effect of high-dimensional covariates. In this paper, we develop a framework for incorporating such dependencies in a high-dimensional logistic regression model by introducing a quadratic interaction term, as in the Ising model, designed to capture the pairwise interactions from the underlying network. The resulting model can also be viewed as an Ising model, where the node-dependent external fields linearly encode the high-dimensional covariates. We propose a penalized maximum pseudo-likelihood method for estimating the network peer-effect and the effect of the covariates (the regression coefficients), which, in addition to handling the high-dimensionality of the parameters, conveniently avoids the computational intractability of the maximum likelihood approach. Under various standard regularity conditions, we show that the corresponding estimate attains the classical high-dimensional rate of consistency. Our results imply that even under network dependence it is possible to consistently estimate the model parameters at the same rate as in classical (independent) logistic regression, when the true parameter is sparse and the underlying network is not too dense. We also develop an efficient algorithm for computing the estimates and validate our theoretical results in numerical experiments. An application to selecting genes in clustering spatial transcriptomics data is also discussed.

Nonparametric Estimation for High-Dimensional Space Models Based on a Deep Neural Network

Neural Network Emulation of Spatio-temporal Data Using Linear and Nonlinear Dimensionality Reduction

Semiparametric Regression for Spatial Data via Deep Learning

Nonparametric spatial autoregressive model using deep neural networks

Spatial Deep Convolutional Neural Networks

Dense ReLU Neural Networks for Temporal-spatial Model

Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression

Nonparametric regression for repeated measurements with deep neural networks

Nonparametric regression using deep neural networks with ReLU activation function

A Generalized Spatial Autoregressive Neural Network Method for Three-Dimensional Spatial Interpolation

Robust Deep Neural Network Estimation for Multi-dimensional Functional Data

Estimation of the Mean Function of Functional Data via Deep Neural Networks

Deep Learning for the Spatial Additive Autoregressive Model with Nonparametric Endogenous Effect

The Nonparametric Estimation of Long Memory Spatio-Temporal Random Field Models

Robust Nonparametric Regression with Deep Neural Networks

Deep learning for higher-order nonparametric spatial autoregressive model

High-Dimensional Non-Parametric Density Estimation in Mixed Smooth Sobolev Spaces

Deep Neural Networks for Nonparametric Interaction Models with Diverging Dimension

High-Dimensional Analysis for Generalized Nonlinear Regression: from Asymptotics to Algorithm

High Dimensional Logistic Regression Under Network Dependence

Variance Estimation in High-Dimensional Linear Regression Via Adaptive Elastic-Net