Abstract:Background: Increasing attention is being given to assessing treatment effect heterogeneity among individuals belonging to qualitatively different latent subgroups. Inference routinely proceeds by first partitioning the individuals into subgroups, then estimating the subgroup-specific average treatment effects. However, because the subgroups are only latently associated with the observed variables, the actual individual subgroup memberships are rarely known with certainty in practice and thus have to be imputed. Ignoring the uncertainty in the imputed memberships precludes misclassification errors, potentially leading to biased results and incorrect conclusions. Methods: We propose a strategy for assessing the sensitivity of inference to classification uncertainty when using such classify-analyze approaches for subgroup effect analyses. We exploit each individual's typically nonzero predictive or posterior subgroup membership probabilities to gauge the stability of the resultant subgroup-specific average causal effects estimates over different, carefully selected subsets of the individuals. Because the membership probabilities are subject to sampling variability, we propose Monte Carlo confidence intervals that explicitly acknowledge the imprecision in the estimated subgroup memberships via perturbations using a parametric bootstrap. The proposal is widely applicable and avoids stringent causal or structural assumptions that existing bias-adjustment or bias-correction methods rely on. Results: Using two different publicly available real-world datasets, we illustrate how the proposed strategy supplements existing latent subgroup effect analyses to shed light on the potential impact of classification uncertainty on inference. First, individuals are partitioned into latent subgroups based on their medical and health history. Then within each fixed latent subgroup, the average treatment effect is assessed using an augmented inverse propensity score weighted estimator. Finally, utilizing the proposed sensitivity analysis reveals different subgroup-specific effects that are mostly insensitive to potential misclassification. Conclusions: Our proposed sensitivity analysis is straightforward to implement, provides both graphical and numerical summaries, and readily permits assessing the sensitivity of any machine learning-based causal effect estimator to classification uncertainty. We recommend making such sensitivity analyses more routine in latent subgroup effect analyses.

Subgroup Analysis of Linear Models with Measurement Error

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Linear mixed effects models for non‐Gaussian continuous repeated measurement data

Analysis of Longitudinal Data with Covariate Measurement Error and Missing Responses: an Improved Unbiased Estimating Equation.

Subgroup identification in clinical trials: an overview of available methods and their implementations with R

Subgroup analysis for longitudinal data based on a partial linear varying coefficient model with a change plane

Multiply Robust Subgroup Analysis Based on a Single-Index Threshold Linear Marginal Model for Longitudinal Data with Dropouts.

Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups

Subgroup Analysis Using Bernoulli-gated Hierarchical Mixtures of Experts Models.

Simultaneous Mean and Covariance Estimation of Partially Linear Models for Longitudinal Data with Missing Responses and Covariate Measurement Error

Robust estimation in linear regression models for longitudinal data with covariate measurement errors and outliers

ROBUST SUBGROUP IDENTIFICATION

Heterogeneous quantile regression for longitudinal data with subgroup structures

Subsampling for Big Data Linear Models with Measurement Errors

A linear mixed model approach for measurement error adjustment: applications to sedentary behavior assessment from wearable devices

Empirical likelihood inference for longitudinal data with covariate measurement errors: An application to the LEAN study

Learning Models from Data with Measurement Error: Tackling Underreporting

Subgroup detection in the heterogeneous partially linear additive Cox model

A Robust Threshold T Linear Mixed Model for Subgroup Identification Using Multivariate T Distributions

Evaluating sensitivity to classification uncertainty in latent subgroup effect analyses

Comparing Approaches to Treatment Effect Estimation for Subgroups in Clinical Trials