Abstract:Background: Increasing attention is being given to assessing treatment effect heterogeneity among individuals belonging to qualitatively different latent subgroups. Inference routinely proceeds by first partitioning the individuals into subgroups, then estimating the subgroup-specific average treatment effects. However, because the subgroups are only latently associated with the observed variables, the actual individual subgroup memberships are rarely known with certainty in practice and thus have to be imputed. Ignoring the uncertainty in the imputed memberships precludes misclassification errors, potentially leading to biased results and incorrect conclusions. Methods: We propose a strategy for assessing the sensitivity of inference to classification uncertainty when using such classify-analyze approaches for subgroup effect analyses. We exploit each individual's typically nonzero predictive or posterior subgroup membership probabilities to gauge the stability of the resultant subgroup-specific average causal effects estimates over different, carefully selected subsets of the individuals. Because the membership probabilities are subject to sampling variability, we propose Monte Carlo confidence intervals that explicitly acknowledge the imprecision in the estimated subgroup memberships via perturbations using a parametric bootstrap. The proposal is widely applicable and avoids stringent causal or structural assumptions that existing bias-adjustment or bias-correction methods rely on. Results: Using two different publicly available real-world datasets, we illustrate how the proposed strategy supplements existing latent subgroup effect analyses to shed light on the potential impact of classification uncertainty on inference. First, individuals are partitioned into latent subgroups based on their medical and health history. Then within each fixed latent subgroup, the average treatment effect is assessed using an augmented inverse propensity score weighted estimator. Finally, utilizing the proposed sensitivity analysis reveals different subgroup-specific effects that are mostly insensitive to potential misclassification. Conclusions: Our proposed sensitivity analysis is straightforward to implement, provides both graphical and numerical summaries, and readily permits assessing the sensitivity of any machine learning-based causal effect estimator to classification uncertainty. We recommend making such sensitivity analyses more routine in latent subgroup effect analyses.

A groupwise approach for inferring heterogeneous treatment effects in causal inference

Estimating the Individual Treatment Effect with Different Treatment Group Sizes

Heterogeneous Treatment Effects in Panel Data

Nonparametric estimation of causal heterogeneity under high-dimensional confounding

Data-Driven Estimation of Heterogeneous Treatment Effects

Estimating individual treatment effect: generalization bounds and algorithms

A Machine-Learning Approach for Estimating Subgroup- and Individual-Level Treatment Effects: An Illustration Using the 65 Trial

Estimating treatment effect heterogeneity in randomized program evaluation

Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups

Causal Inference using Multivariate Generalized Linear Mixed-Effects Models with Longitudinal Data

Estimation of Heterogeneous Treatment Effects Using a Conditional Moment Based Approach

Group Average Treatment Effects for Observational Studies

A General Framework for Treatment Effect Estimation in Semi-Supervised and High Dimensional Settings

On Inductive Biases for Heterogeneous Treatment Effect Estimation

Evaluating sensitivity to classification uncertainty in latent subgroup effect analyses

Recovering Sparse and Interpretable Subgroups with Heterogeneous Treatment Effects with Censored Time-to-Event Outcomes

Comparison of methods that combine multiple randomized trials to estimate heterogeneous treatment effects

Estimation and Inference of Heterogeneous Treatment Effects using Random Forests

Causal Inference for a Hidden Treatment

Uncovering Sociological Effect Heterogeneity using Machine Learning

A robust and efficient approach to causal inference based on sparse sufficient dimension reduction