Abstract:Background: Increasing attention is being given to assessing treatment effect heterogeneity among individuals belonging to qualitatively different latent subgroups. Inference routinely proceeds by first partitioning the individuals into subgroups, then estimating the subgroup-specific average treatment effects. However, because the subgroups are only latently associated with the observed variables, the actual individual subgroup memberships are rarely known with certainty in practice and thus have to be imputed. Ignoring the uncertainty in the imputed memberships precludes misclassification errors, potentially leading to biased results and incorrect conclusions. Methods: We propose a strategy for assessing the sensitivity of inference to classification uncertainty when using such classify-analyze approaches for subgroup effect analyses. We exploit each individual's typically nonzero predictive or posterior subgroup membership probabilities to gauge the stability of the resultant subgroup-specific average causal effects estimates over different, carefully selected subsets of the individuals. Because the membership probabilities are subject to sampling variability, we propose Monte Carlo confidence intervals that explicitly acknowledge the imprecision in the estimated subgroup memberships via perturbations using a parametric bootstrap. The proposal is widely applicable and avoids stringent causal or structural assumptions that existing bias-adjustment or bias-correction methods rely on. Results: Using two different publicly available real-world datasets, we illustrate how the proposed strategy supplements existing latent subgroup effect analyses to shed light on the potential impact of classification uncertainty on inference. First, individuals are partitioned into latent subgroups based on their medical and health history. Then within each fixed latent subgroup, the average treatment effect is assessed using an augmented inverse propensity score weighted estimator. Finally, utilizing the proposed sensitivity analysis reveals different subgroup-specific effects that are mostly insensitive to potential misclassification. Conclusions: Our proposed sensitivity analysis is straightforward to implement, provides both graphical and numerical summaries, and readily permits assessing the sensitivity of any machine learning-based causal effect estimator to classification uncertainty. We recommend making such sensitivity analyses more routine in latent subgroup effect analyses.

Subgroup Analysis Using Bernoulli-gated Hierarchical Mixtures of Experts Models.

Exploring Heterogeneity in Clinical Trials with Latent Class Analysis

Subgroup identification in clinical trials: an overview of available methods and their implementations with R

Heterogeneous quantile regression for longitudinal data with subgroup structures

Evaluating sensitivity to classification uncertainty in latent subgroup effect analyses

Subgroup Analysis of Linear Models with Measurement Error

Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups

The application of Bayesian method in estimating heterogeneity of treatment effect

Bayesian Shrinkage Estimation of Credible Subgroups for Count Data with Excess Zeros

Mixed‐Effect Hybrid Models for Longitudinal Data with Nonignorable Dropout

A groupwise approach for inferring heterogeneous treatment effects in causal inference

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

A Robust Threshold T Linear Mixed Model for Subgroup Identification Using Multivariate T Distributions

Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning

Subgroup Analysis Via Recursive Partitioning

Regression and Subgroup Detection for Heterogeneous Samples

Multiply Robust Subgroup Analysis Based on a Single-Index Threshold Linear Marginal Model for Longitudinal Data with Dropouts.

Subgroup Mixable Inference in Personalized Medicine, with an Application to Time-to-Event Outcomes

Estimating Heterogeneous Treatment Effects: Mutual Information Bounds and Learning Algorithms.

Modeling Heterogeneity and Missing Data of Multiple Longitudinal Outcomes in Electronic Health Records

Identification of Subgroups With Similar Benefits in Off-Policy Policy Evaluation