Abstract:Background: Increasing attention is being given to assessing treatment effect heterogeneity among individuals belonging to qualitatively different latent subgroups. Inference routinely proceeds by first partitioning the individuals into subgroups, then estimating the subgroup-specific average treatment effects. However, because the subgroups are only latently associated with the observed variables, the actual individual subgroup memberships are rarely known with certainty in practice and thus have to be imputed. Ignoring the uncertainty in the imputed memberships precludes misclassification errors, potentially leading to biased results and incorrect conclusions. Methods: We propose a strategy for assessing the sensitivity of inference to classification uncertainty when using such classify-analyze approaches for subgroup effect analyses. We exploit each individual's typically nonzero predictive or posterior subgroup membership probabilities to gauge the stability of the resultant subgroup-specific average causal effects estimates over different, carefully selected subsets of the individuals. Because the membership probabilities are subject to sampling variability, we propose Monte Carlo confidence intervals that explicitly acknowledge the imprecision in the estimated subgroup memberships via perturbations using a parametric bootstrap. The proposal is widely applicable and avoids stringent causal or structural assumptions that existing bias-adjustment or bias-correction methods rely on. Results: Using two different publicly available real-world datasets, we illustrate how the proposed strategy supplements existing latent subgroup effect analyses to shed light on the potential impact of classification uncertainty on inference. First, individuals are partitioned into latent subgroups based on their medical and health history. Then within each fixed latent subgroup, the average treatment effect is assessed using an augmented inverse propensity score weighted estimator. Finally, utilizing the proposed sensitivity analysis reveals different subgroup-specific effects that are mostly insensitive to potential misclassification. Conclusions: Our proposed sensitivity analysis is straightforward to implement, provides both graphical and numerical summaries, and readily permits assessing the sensitivity of any machine learning-based causal effect estimator to classification uncertainty. We recommend making such sensitivity analyses more routine in latent subgroup effect analyses.

Robust Inference for Subgroup Analysis with General Transformation Models

ROBUST SUBGROUP IDENTIFICATION

Subgroup identification in clinical trials: an overview of available methods and their implementations with R

A Robust Threshold T Linear Mixed Model for Subgroup Identification Using Multivariate T Distributions

Regression and Subgroup Detection for Heterogeneous Samples

Multiply Robust Subgroup Analysis Based on a Single-Index Threshold Linear Marginal Model for Longitudinal Data with Dropouts.

Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning

Exploring Heterogeneity in Clinical Trials with Latent Class Analysis

Subgroup detection in the heterogeneous partially linear additive Cox model

Subgroup Analysis of Linear Models with Measurement Error

Subgroup analysis for heterogeneous additive partially linear models and its application to car sales data

Structural modeling using overlapped group penalties for discovering predictive biomarkers for subgroup analysis

Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups

Subgroup Analysis Using Bernoulli-gated Hierarchical Mixtures of Experts Models.

Evaluating sensitivity to classification uncertainty in latent subgroup effect analyses

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

Robust structured heterogeneity analysis approach for high-dimensional data

Data-Driven Subgroup Identification for Linear Regression

Subgroup analysis with concave pairwise fusion penalty for ordinal response

Recovering Sparse and Interpretable Subgroups with Heterogeneous Treatment Effects with Censored Time-to-Event Outcomes

Multiply Robust Subgroup Identification for Longitudinal Data with Dropouts Via Median Regression