Abstract:Background: Increasing attention is being given to assessing treatment effect heterogeneity among individuals belonging to qualitatively different latent subgroups. Inference routinely proceeds by first partitioning the individuals into subgroups, then estimating the subgroup-specific average treatment effects. However, because the subgroups are only latently associated with the observed variables, the actual individual subgroup memberships are rarely known with certainty in practice and thus have to be imputed. Ignoring the uncertainty in the imputed memberships precludes misclassification errors, potentially leading to biased results and incorrect conclusions. Methods: We propose a strategy for assessing the sensitivity of inference to classification uncertainty when using such classify-analyze approaches for subgroup effect analyses. We exploit each individual's typically nonzero predictive or posterior subgroup membership probabilities to gauge the stability of the resultant subgroup-specific average causal effects estimates over different, carefully selected subsets of the individuals. Because the membership probabilities are subject to sampling variability, we propose Monte Carlo confidence intervals that explicitly acknowledge the imprecision in the estimated subgroup memberships via perturbations using a parametric bootstrap. The proposal is widely applicable and avoids stringent causal or structural assumptions that existing bias-adjustment or bias-correction methods rely on. Results: Using two different publicly available real-world datasets, we illustrate how the proposed strategy supplements existing latent subgroup effect analyses to shed light on the potential impact of classification uncertainty on inference. First, individuals are partitioned into latent subgroups based on their medical and health history. Then within each fixed latent subgroup, the average treatment effect is assessed using an augmented inverse propensity score weighted estimator. Finally, utilizing the proposed sensitivity analysis reveals different subgroup-specific effects that are mostly insensitive to potential misclassification. Conclusions: Our proposed sensitivity analysis is straightforward to implement, provides both graphical and numerical summaries, and readily permits assessing the sensitivity of any machine learning-based causal effect estimator to classification uncertainty. We recommend making such sensitivity analyses more routine in latent subgroup effect analyses.

A Shrinkage Likelihood Ratio Test for High-Dimensional Subgroup Analysis with a Logistic-Normal Mixture Model

A Shrinkage Method for Testing the Hardy–Weinberg Equilibrium in Case‐Control Studies

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Bayesian Shrinkage Estimation of Credible Subgroups for Count Data with Excess Zeros

Testing the Order of Multivariate Normal Mixture Models

A Note on the Likelihood Ratio Test in High-Dimensional Exploratory Factor Analysis

Moderate Deviation Principles for Classical Likelihood Ratio Tests of High-Dimensional Normal Distributions.

Testing generalized linear models with high-dimensional nuisance parameter.

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Subgroup Analysis with Time‐to‐Event Data under a Logistic‐Cox Mixture Model

Likelihood ratio tests under model misspecification in high dimensions

A Robust Threshold T Linear Mixed Model for Subgroup Identification Using Multivariate T Distributions

High-dimensional general linear hypothesis tests via non-linear spectral shrinkage

Testing high-dimensional multinomials with applications to text analysis

Nonparametric Additive Regression for High-Dimensional Group Testing Data

Change-Plane Analysis for Subgroup Detection and Sample Size Calculation

Evaluating sensitivity to classification uncertainty in latent subgroup effect analyses

Two-Sample Test for Sparse High Dimensional Multinomial Distributions

Linear hypothesis testing in ultra high dimensional generalized linear mixed models

LINEAR HYPOTHESIS TESTING FOR HIGH DIMENSIONAL GENERALIZED LINEAR MODELS.

Model-Free Statistical Inference on High-Dimensional Data