Abstract:We consider after-study statistical inference for sequentially designed experiments wherein multiple units are assigned treatments for multiple time points using treatment policies that adapt over time. Our goal is to provide inference guarantees for the counterfactual mean at the smallest possible scale -- mean outcome under different treatments for each unit and each time -- with minimal assumptions on the adaptive treatment policy. Without any structural assumptions on the counterfactual means, this challenging task is infeasible due to more unknowns than observed data points. To make progress, we introduce a latent factor model over the counterfactual means that serves as a non-parametric generalization of the non-linear mixed effects model and the bilinear latent factor model considered in prior works. For estimation, we use a non-parametric method, namely a variant of nearest neighbors, and establish a non-asymptotic high probability error bound for the counterfactual mean for each unit and each time. Under regularity conditions, this bound leads to asymptotically valid confidence intervals for the counterfactual mean as the number of units and time points grows to $\infty$ together at suitable rates. We illustrate our theory via several simulations and a case study involving data from a mobile health clinical trial HeartSteps.

Counterfactuals for the Future

Longitudinal Counterfactuals: Constraints and Opportunities

MIMICKING COUNTERFACTUAL OUTCOMES TO ESTIMATE CAUSAL EFFECTS

What Counterfactuals Can Be Tested

A Practical Guide to Counterfactual Estimators for Causal Inference with Time-Series Cross-Sectional Data

Using counterfactuals in knowledge-based programming

On Counterfactual Reasoning

Past and Future: Backward and Forward Discounting

Simulating counterfactuals

Counterfactual Analysis and Inference With Nonstationary Data

Natural Counterfactuals With Necessary Backtracking

Counterfactual thoughts in complex causal domain: content, benefits, and implications for their function

Counterfactual Causality from First Principles?

Deep Backtracking Counterfactuals for Causally Compliant Explanations

Counterfactual inference for sequential experiments

Counterfactual Reasoning: Sharpening Conceptual Distinctions in Developmental Studies

Counterfactual: An R Package for Counterfactual Analysis

Rational Counterfactuals

Counterfactual Imputation: Comments on "Imputation of Counterfactual Outcomes when the Errors are Predictable" by Silvia Gonçalves and Serena Ng

Mitigating the Rashomon Effect in Counterfactual Explanation: A Game-theoretic Approach

Counterfactual Explanations for Time Series Forecasting