Abstract:This paper studies inference in randomized controlled trials with multiple treatments, where treatment status is determined according to a “matched tuples” design. If there are | D | possible treatments, then by a matched tuples design, we mean an experimental design where units are sampled i.i.d. from the population of interest, grouped into “homogeneous” blocks of size | D | , and finally, within each block, exactly one individual is randomly assigned to each of the | D | treatments. We first study estimation and inference for matched tuples designs in the general setting where the parameter of interest is a vector of linear contrasts over the collection of average potential outcomes for each treatment. Parameters of this form include standard average treatment effects used to compare one treatment relative to another, but also include parameters that may be of interest in the analysis of factorial designs. We first establish conditions under which a sample analog estimator is asymptotically normal and construct a consistent estimator of its corresponding asymptotic variance. Combining these results establish the asymptotic exactness of tests based on these estimators. In contrast, we show that, for two common testing procedures based on t ‐tests constructed from linear regressions, one test is generally conservative while the other is generally invalid. We go on to apply our results to study the asymptotic properties of what we call “fully‐blocked” 2 K factorial designs, which are simply matched tuples designs applied to a full factorial experiment. Leveraging our previous results, we establish that our estimator achieves a lower asymptotic variance under the fully‐blocked design than that under any stratified factorial design, which stratifies the experimental sample into a finite number of “large” strata. A simulation study and empirical application illustrate the practical relevance of our results.

A modified Friedman test for randomized complete block designs

A generalization of Friedman's rank statistic

Log-rank tests for censored clustered data under generalized randomized block design: Saddlepoint approximation

A Graphical Approach for Friedman Test: Moments Approach

Nonparametric Response-Adaptive Randomization for Continuous Responses

A theory of contrasts for modified Freeman–Tukey statistics and its applications to Tukey's post-hoc tests for contingency tables

Saddlepoint approximation for weighted log-rank tests based on block truncated binomial design

Efficient Randomized-Adaptive Designs

Testing Hypotheses of Covariate-Adaptive Randomized Clinical Trials with Time-to-event Outcomes under the AFT Model

The Optimality of Blocking Designs in Equally and Unequally Allocated Randomized Experiments with General Response

Testing Equality of Treatments under an Incomplete Block Crossover Design with Ordinal Responses

Inference for matched tuples and fully blocked factorial designs

Design-Based Theory for Lasso Adjustment in Randomized Block Experiments and Rerandomized Experiments

Robust Tests for Treatment Effect in Survival Analysis under Covariate-Adaptive Randomization

The uniform general signed rank test and its design sensitivity

Randomization-based Joint Central Limit Theorem and Efficient Covariate Adjustment in Randomized Block 2K Factorial Experiments

E- and R-optimality of block designs for treatment-control comparisons

Exact p-values for pairwise comparison of Friedman rank sums, with application to comparing classifiers

Rank-Based Procedures in Factorial Designs: Hypotheses about Nonparametric Treatment Effects

Sample size determination based on rank tests in clinical trials.

Testing for Treatment Effect in Covariate-Adaptive Randomized Clinical Trials with Generalized Linear Models and Omitted Covariates