Abstract:This paper studies inference in two-stage randomized experiments under covariate-adaptive randomization. In the initial stage of this experimental design, clusters (e.g., households, schools, or graph partitions) are stratified and randomly assigned to control or treatment groups based on cluster-level covariates. Subsequently, an independent second-stage design is carried out, wherein units within each treated cluster are further stratified and randomly assigned to either control or treatment groups, based on individual-level covariates. Under the homogeneous partial interference assumption, I establish conditions under which the proposed difference-in-"average of averages" estimators are consistent and asymptotically normal for the corresponding average primary and spillover effects and develop consistent estimators of their asymptotic variances. Combining these results establishes the asymptotic validity of tests based on these estimators. My findings suggest that ignoring covariate information in the design stage can result in efficiency loss, and commonly used inference methods that ignore or improperly use covariate information can lead to either conservative or invalid inference. Finally, I apply these results to studying optimal use of covariate information under covariate-adaptive randomization in large samples, and demonstrate that a specific generalized matched-pair design achieves minimum asymptotic variance for each proposed estimator. The practical relevance of the theoretical results is illustrated through a simulation study and an empirical application.

On Randomization-based and Regression-based Inferences for 2^K Factorial Designs

Sharpening randomization-based causal inference for $2^2$ factorial designs with binary outcomes

On randomization-based causal inference for matched-pair factorial designs

Improving Covariate Balance in 2^K Factorial Designs via Rerandomization

Randomization-based Joint Central Limit Theorem and Efficient Covariate Adjustment in Randomized Block 2K Factorial Experiments

Optimal allocation of sample size for randomization-based inference from 2 K factorial designs

Causal Inference from 2^k Factorial Designs Using the Potential Outcomes Model

Causal Inference From 2(K) Factorial Designs By Using Potential Outcomes

Causal Inference from 2K Factorial Designs by Using Potential Outcomes

Rerandomization in $2^K$ Factorial Experiments

Randomization-based joint central limit theorem and efficient covariate adjustment in stratified $2^K$ factorial experiments

Regression-based causal inference with factorial experiments: estimands, model specifications, and design-based properties

Randomization-based Causal Inference from Split-Plot Designs

Rerandomization in 2 K factorial experiments

On the Optimality of Randomization in Experimental Design: How to Randomize for Minimax Variance and Design-Based Inference

Improving Covariate Balance in 2K Factorial Designs Via Rerandomization with an Application to a New York City Department of Education High School Study

Inference for Two-stage Experiments under Covariate-Adaptive Randomization

Optimal Designs for 2^k Factorial Experiments with Binary Response

Selective Randomization Inference for Adaptive Experiments

Forward selection and post-selection inference in factorial designs

Inference under covariate-adaptive randomization with many strata