Abstract:Personalized decision making requires the knowledge of potential outcomes under different treatments, and confidence intervals about the potential outcomes further enrich this decision-making process and improve its reliability in high-stakes scenarios. Predicting potential outcomes along with its uncertainty in a counterfactual world poses the foundamental challenge in causal inference. Existing methods that construct confidence intervals for counterfactuals either rely on the assumption of strong ignorability, or need access to un-identifiable lower and upper bounds that characterize the difference between observational and interventional distributions. To overcome these limitations, we first propose a novel approach wTCP-DR based on transductive weighted conformal prediction, which provides confidence intervals for counterfactual outcomes with marginal converage guarantees, even under hidden confounding. With less restrictive assumptions, our approach requires access to a fraction of interventional data (from randomized controlled trials) to account for the covariate shift from observational distributoin to interventional distribution. Theoretical results explicitly demonstrate the conditions under which our algorithm is strictly advantageous to the naive method that only uses interventional data. After ensuring valid intervals on counterfactuals, it is straightforward to construct intervals for individual treatment effects (ITEs). We demonstrate our method across synthetic and real-world data, including recommendation systems, to verify the superiority of our methods compared against state-of-the-art baselines in terms of both coverage and efficiency

Integrative conformal p -values for out-of-distribution testing with labelled outliers

Transductive conformal inference with adaptive scores

Model-free selective inference under covariate shift via weighted conformal p-values

Out-of-Distribution Detection Should Use Conformal Prediction (and Vice-versa?)

Optimized Conformal Selection: Powerful Selective Inference After Conformity Score Optimization

Selection by Prediction with Conformal p-values

Towards In-Distribution Compatible Out-of-Distribution Detection.

Asymptotics for Outlier Hypothesis Testing

Asymptotics for conformal inference

Conformalized Survival Distributions: A Generic Post-Process to Increase Calibration

Inductive Conformal Prediction under Data Scarcity: Exploring the Impacts of Nonconformity Measures

Conformal Prediction using Conditional Histograms

Posterior Conformal Prediction

Conformal Inference for Invariant Risk Minimization

Prediction and outlier detection in classification problems

Selective conformal inference with false coverage-statement rate control

Conformal Classification with Equalized Coverage for Adaptively Selected Groups

Uncertainty Quantification in Anomaly Detection with Cross-Conformal $p$-Values

A Constrained Bayesian Approach to Out-of-distribution Prediction.

Conformal Inference of Counterfactuals and Individual Treatment Effects

Conformal Counterfactual Inference under Hidden Confounding