Abstract:We investigate the problem of machine learning-based (ML) predictive inference on individual treatment effects (ITEs). Previous work has focused primarily on developing ML-based meta-learners that can provide point estimates of the conditional average treatment effect (CATE); these are model-agnostic approaches for combining intermediate nuisance estimates to produce estimates of CATE. In this paper, we develop conformal meta-learners, a general framework for issuing predictive intervals for ITEs by applying the standard conformal prediction (CP) procedure on top of CATE meta-learners. We focus on a broad class of meta-learners based on two-stage pseudo-outcome regression and develop a stochastic ordering framework to study their validity. We show that inference with conformal meta-learners is marginally valid if their (pseudo outcome) conformity scores stochastically dominate oracle conformity scores evaluated on the unobserved ITEs. Additionally, we prove that commonly used CATE meta-learners, such as the doubly-robust learner, satisfy a model- and distribution-free stochastic (or convex) dominance condition, making their conformal inferences valid for practically-relevant levels of target coverage. Whereas existing procedures conduct inference on nuisance parameters (i.e., potential outcomes) via weighted CP, conformal meta-learners enable direct inference on the target parameter (ITE). Numerical experiments show that conformal meta-learners provide valid intervals with competitive efficiency while retaining the favorable point estimation properties of CATE meta-learners.

Meta-Learners for Partially-Identified Treatment Effects Across Multiple Environments

Multi-CATE: Multi-Accurate Conditional Average Treatment Effect Estimation Robust to Unknown Covariate Shifts

Learning Representations of Instruments for Partial Identification of Treatment Effects

Meta-learning for heterogeneous treatment effect estimation with closed-form solvers

Estimating Heterogeneous Treatment Effects by Combining Weak Instruments and Observational Data

Conformal Convolution and Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects

Metalearners for estimating heterogeneous treatment effects using machine learning

Estimating individual treatment effect: generalization bounds and algorithms

B-Learner: Quasi-Oracle Bounds on Heterogeneous Causal Effects Under Hidden Confounding

CATE meets ML -- The Conditional Average Treatment Effect and Machine Learning

Conformal Meta-learners for Predictive Inference of Individual Treatment Effects

Transfer Learning on Heterogeneous Feature Spaces for Treatment Effects Estimation

Doubly Robust Direct Learning for Estimating Conditional Average Treatment Effect

Using Machine Learning to Individualize Treatment Effect Estimation: Challenges and Opportunities

Measuring Variable Importance in Individual Treatment Effect Estimation with High Dimensional Data

Model-agnostic meta-learners for estimating heterogeneous treatment effects over time

Causal machine learning for heterogeneous treatment effects in the presence of missing outcome data

From Text to Treatment Effects: A Meta-Learning Approach to Handling Text-Based Confounding

Robust and Agnostic Learning of Conditional Distributional Treatment Effects

Flexible machine learning estimation of conditional average treatment effects: a blessing and a curse

Triple/Debiased Lasso for Statistical Inference of Conditional Average Treatment Effects