Abstract:Evaluating the treatment effects has become an important topic for many applications. However, most existing literature focuses mainly on the average treatment effects. When the individual effects are heavy-tailed or have outlier values, not only may the average effect not be appropriate for summarizing the treatment effects, but also the conventional inference for it can be sensitive and possibly invalid due to poor large-sample approximations. In this paper we focus on quantiles of individual effects, which can be more robust measures of treatment effects in the presence of extreme individual effects. Moreover, our inference for quantiles of individual effects are purely randomization-based, which avoids any distributional assumption on the units. We first consider inference for stratified randomized experiments, extending the recent work of Caughey et al. (2021). The calculation of valid $p$-values for testing null hypotheses on quantiles of individual effects involves linear integer programming, which is generally NP hard. To overcome this issue, we propose a greedy algorithm with a certain optimal transformation, which has much lower computational cost, still leads to valid $p$-values and is less conservative than the usual relaxation by dropping the integer constraint. We then extend our approach to matched observational studies and propose sensitivity analysis to investigate to what extent our inference on quantiles of individual effects is robust to unmeasured confounding. Both the randomization inference and sensitivity analysis are simultaneously valid for all quantiles of individual effects, which are actually free lunches added to the conventional analysis assuming constant effects. Furthermore, the inference results can be easily visualized and interpreted.

Conformal Sensitivity Analysis for Individual Treatment Effects

Sensitivity analysis of individual treatment effects: A robust conformal inference approach

Conformal Inference of Counterfactuals and Individual Treatment Effects

Estimating individual treatment effect: generalization bounds and algorithms

Conformal Diffusion Models for Individual Treatment Effect Estimation and Inference

Optimal Statistical Inference for Individualized Treatment Effects in High-dimensional Models

Conformal Meta-learners for Predictive Inference of Individual Treatment Effects

Sensitivity Analysis via the Proportion of Unmeasured Confounding

Model-assisted sensitivity analysis for treatment effects under unmeasured confounding via regularized calibrated estimation

Conformal Counterfactual Inference under Hidden Confounding

Interval Estimation of Individual-Level Causal Effects under Unobserved Confounding

A flexible sensitivity analysis approach for unmeasured confounding with multiple treatments and a binary outcome with application to SEER-Medicare lung cancer data

Treatment Effect Risk: Bounds and Inference

On the Role of Surrogates in Conformal Inference of Individual Causal Effects

Estimating Individual Dose-Response Curves under Unobserved Confounders from Observational Data

Conformal Convolution and Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects

Treatment Effect Quantiles in Stratified Randomized Experiments and Matched Observational Studies

Flexible sensitivity analysis for causal inference in observational studies subject to unmeasured confounding

Individual Treatment Prescription Effect Estimation in a Low Compliance Setting