Abstract:Due to the prevalence of complex data, data heterogeneity is often observed in contemporary scientific studies and various applications. Motivated by studies on cancer cell lines, we consider the analysis of heterogeneous subpopulations with binary responses and high-dimensional covariates. In many practical scenarios, it is common to use a single regression model for the entire data set. To do this effectively, it is critical to quantify the heterogeneity of the effect of covariates across subpopulations through appropriate statistical inference. However, the high dimensionality and discrete nature of the data can lead to challenges in inference. Therefore, we propose a novel statistical inference method for a high-dimensional logistic regression model that accounts for heterogeneous subpopulations. Our primary goal is to investigate heterogeneity across subpopulations by testing the equivalence of the effect of a covariate and the significance of the overall effects of a covariate. To achieve overall sparsity of the coefficients and their fusions across subpopulations, we employ a fused group Lasso penalization method. In addition, we develop a statistical inference method that incorporates bias correction of the proposed penalized method. To address computational issues due to the nonlinear log-likelihood and the fused Lasso penalty, we propose a computationally efficient and fast algorithm by adapting the ideas of the proximal gradient method and the alternating direction method of multipliers (ADMM) to our settings. Furthermore, we develop non-asymptotic analyses for the proposed fused group Lasso and prove that the debiased test statistics admit chi-squared approximations even in the presence of high-dimensional variables. In simulations, the proposed test outperforms existing methods. The practical effectiveness of the proposed method is demonstrated by analyzing data from the Cancer Cell Line Encyclopedia (CCLE).

Communication Theoretic Inference on Heterogeneous Data.

How Data Heterogeneity Affects Innovating Knowledge and Information in Gene Identification: A Statistical Learning Perspective

Communication Theoretic Data Analytics

Heterogeneity-aware and communication-efficient distributed statistical inference

Distributed Computing and Inference for Big Data

Debiased inference for heterogeneous subpopulations in a high-dimensional logistic regression model

On the inference about the spectral distribution of high-dimensional covariance matrix based on high-frequency noisy observations

Communications Inspired Linear Discriminant Analysis

The Implicit Bias of Heterogeneity towards Invariance: A Study of Multi-Environment Matrix Sensing

Optimal Cooperative Inference

Statistical Inferences for Complex Dependence of Multimodal Imaging Data

Information Splitting for Big Data Analytics

Median Selection Subset Aggregation for Parallel Inference

Learning Heterogeneity in Causal Inference Using Sufficient Dimension Reduction

Heterogeneity-aware Clustered Distributed Learning for Multi-source Data Analysis

Inference on High-dimensional Single-index Models with Streaming Data

Unifying Approaches in Active Learning and Active Sampling via Fisher Information and Information-Theoretic Quantities

Communication-constrained hypothesis testing: Optimality, robustness, and reverse data processing inequalities

Robust Direct Learning for Causal Data Fusion

Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach

Tuning-Free Heterogeneity Pursuit in Massive Networks