Abstract:Consider a setting where there are $N$ heterogeneous units and $p$ interventions. Our goal is to learn unit-specific potential outcomes for any combination of these $p$ interventions, i.e., $N \times 2^p$ causal parameters. Choosing a combination of interventions is a problem that naturally arises in a variety of applications such as factorial design experiments, recommendation engines, combination therapies in medicine, conjoint analysis, etc. Running $N \times 2^p$ experiments to estimate the various parameters is likely expensive and/or infeasible as $N$ and $p$ grow. Further, with observational data there is likely confounding, i.e., whether or not a unit is seen under a combination is correlated with its potential outcome under that combination. To address these challenges, we propose a novel latent factor model that imposes structure across units (i.e., the matrix of potential outcomes is approximately rank $r$), and combinations of interventions (i.e., the coefficients in the Fourier expansion of the potential outcomes is approximately $s$ sparse). We establish identification for all $N \times 2^p$ parameters despite unobserved confounding. We propose an estimation procedure, Synthetic Combinations, and establish it is finite-sample consistent and asymptotically normal under precise conditions on the observation pattern. Our results imply consistent estimation given $\text{poly}(r) \times \left( N + s^2p\right)$ observations, while previous methods have sample complexity scaling as $\min(N \times s^2p, \ \ \text{poly(r)} \times (N + 2^p))$. We use Synthetic Combinations to propose a data-efficient experimental design. Empirically, Synthetic Combinations outperforms competing approaches on a real-world dataset on movie recommendations. Lastly, we extend our analysis to do causal inference where the intervention is a permutation over $p$ items (e.g., rankings).

A-ComVar: A Flexible Extension of Common Variance Design

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

Covariate-adjusted response-adaptive designs for generalized linear models

Alias‐informed model selection (AIMS) for 7 and 8 factor no‐confounding 16‐run fractional factorial designs

Unifying Design-based Inference: On Bounding and Estimating the Variance of any Linear Estimator in any Experimental Design

A New Family of Covariate-Adjusted Response Adaptive Designs and Their Properties

Interaction Balance for Symmetrical Factorial Designs with Generalized Minimum Aberration

Regression-based causal inference with factorial experiments: estimands, model specifications, and design-based properties

Evaluation of combinatorial optimisation algorithms for c-optimal experimental designs with correlated observations

Minimum Secondary Aberration Fractional Factorial Split-Plot Designs in Terms of Consulting Designs

Computer Programs for Robust Analyses in Multifactor Analysis of Variance Designs

Simulation-Based Power Analysis for Factorial Analysis of Variance Designs

Synthetic Combinations: A Causal Inference Framework for Combinatorial Interventions

Synthetic Principal Component Design: Fast Covariate Balancing with Synthetic Controls

Understanding Factorial Designs, Main Effects, and Interaction Effects: Simply Explained with a Worked Example

Sparse matrix methods for unbalanced multifactor analysis of variance and covariance

Optimal experimental designs for treatment contrasts in heteroscedastic models with covariates

A Class of Multilevel Nonregular Designs for Studying Quantitative Factors

Analysis of variance and the magnitude of effects: A general approach.

Permutation Strategies for Inference in ANOVA‐Based Models for Nonorthogonal Designs Including Continuous Covariates

Improving Covariate Balance in 2^K Factorial Designs via Rerandomization