Abstract:This paper studies inference in randomized controlled trials with multiple treatments, where treatment status is determined according to a “matched tuples” design. If there are | D | possible treatments, then by a matched tuples design, we mean an experimental design where units are sampled i.i.d. from the population of interest, grouped into “homogeneous” blocks of size | D | , and finally, within each block, exactly one individual is randomly assigned to each of the | D | treatments. We first study estimation and inference for matched tuples designs in the general setting where the parameter of interest is a vector of linear contrasts over the collection of average potential outcomes for each treatment. Parameters of this form include standard average treatment effects used to compare one treatment relative to another, but also include parameters that may be of interest in the analysis of factorial designs. We first establish conditions under which a sample analog estimator is asymptotically normal and construct a consistent estimator of its corresponding asymptotic variance. Combining these results establish the asymptotic exactness of tests based on these estimators. In contrast, we show that, for two common testing procedures based on t ‐tests constructed from linear regressions, one test is generally conservative while the other is generally invalid. We go on to apply our results to study the asymptotic properties of what we call “fully‐blocked” 2 K factorial designs, which are simply matched tuples designs applied to a full factorial experiment. Leveraging our previous results, we establish that our estimator achieves a lower asymptotic variance under the fully‐blocked design than that under any stratified factorial design, which stratifies the experimental sample into a finite number of “large” strata. A simulation study and empirical application illustrate the practical relevance of our results.

The analysis of randomized experiments with orthogonal block structure. II. Treatment structure and the general analysis of variance

E- and R-optimality of block designs for treatment-control comparisons

Randomization-based Joint Central Limit Theorem and Efficient Covariate Adjustment in Randomized Block 2K Factorial Experiments

Efficient Designs in Small Blocks for Comparing Consecutive Pairs of Treatments

Efficient Balanced Treatment Assignments for Experimentation

Causal Inference of Social Experiments Using Orthogonal Designs

The Optimality of Blocking Designs in Equally and Unequally Allocated Randomized Experiments with General Response

Inference for matched tuples and fully blocked factorial designs

Nearly Resolution V Plans on Blocks of Small Size

Randomization-based joint central limit theorem and efficient covariate adjustment in stratified $2^K$ factorial experiments

Optimal Designs For Two Non-Interactive Treatment

Heterogeneous Treatment Effects for Networks, Panels, and other Outcome Matrices

Some theoretical foundations for the design and analysis of randomized experiments

Asymptotic Theory of Rerandomization in Treatment-Control Experiments

Optimal allocation of sample size for randomization-based inference from 2 K factorial designs

Optimal experimental designs for treatment contrasts in heteroscedastic models with covariates

Design-Based Theory for Lasso Adjustment in Randomized Block Experiments and Rerandomized Experiments

Optimal designs for multiple treatments with unequal variances

Some New Classes of Orthogonal Latin Hypercube Designs

Optimal orthogonal designs for experiments with four-level and two-level factors

Cluster Randomized Trials with a Pretest and Posttest: Equivalence of Three-, Two- and One-Level Analyses, and Sample Size Calculation