Abstract:Background: Cluster randomized trials (CRTs) are randomized trials where randomization takes place at an administrative level (e.g., hospitals, clinics, or schools) rather than at the individual level. When the number of available clusters is small, researchers may not be able to rely on simple randomization to achieve balance on cluster-level covariates across treatment conditions. If these cluster-level covariates are predictive of the outcome, covariate imbalance may distort treatment effects, threaten internal validity, lead to a loss of power, and increase the variability of treatment effects. Covariate-constrained randomization (CR) is a randomization strategy designed to reduce the risk of imbalance in cluster-level covariates when performing a CRT. Existing methods for CR have been developed and evaluated for two- and multi-arm CRTs but not for factorial CRTs. Methods: Motivated by the BEGIN study-a CRT for weight loss among patients with pre-diabetes-we develop methods for performing CR in 2 × 2 factorial cluster randomized trials with a continuous outcome and continuous cluster-level covariates. We apply our methods to the BEGIN study and use simulation to assess the performance of CR versus simple randomization for estimating treatment effects by varying the number of clusters, the degree to which clusters are associated with the outcome, the distribution of cluster level covariates, the size of the constrained randomization space, and analysis strategies. Results: Compared to simple randomization of clusters, CR in the factorial setting is effective at achieving balance across cluster-level covariates between treatment conditions and provides more precise inferences. When cluster-level covariates are included in the analyses model, CR also results in greater power to detect treatment effects, but power is low compared to unadjusted analyses when the number of clusters is small. Conclusions: CR should be used instead of simple randomization when performing factorial CRTs to avoid highly imbalanced designs and to obtain more precise inferences. Except when there are a small number of clusters, cluster-level covariates should be included in the analysis model to increase power and maintain coverage and type 1 error rates at their nominal levels.

Meta-analysis of community-based cluster randomization trials with binary outcomes

Comparison of tests for categorical data from a stratified cluster randomized trial

Intent-to-treat Analysis of Cluster Randomized Trials when Clusters Report Unidentifiable Outcome Proportions.

Cluster Randomized Trials with a Pretest and Posttest: Equivalence of Three-, Two- and One-Level Analyses, and Sample Size Calculation

Meta‐Analysis of Studies with Missing Data

Estimating an adjusted risk difference in a cluster randomized trial with individual-level analyses

Using Power Analysis to Choose the Unit of Randomization, Outcome, and Approach for Subgroup Analysis for a Multilevel Randomized Controlled Clinical Trial to Reduce Disparities in Cardiovascular Health

Meta-Analytical Approaches to Ordinal Outcome Data in Clinical Interventional Studies: A Scoping Review with Reproducible Research

Evaluation of the type I error rate when using parametric bootstrap analysis of a cluster randomized controlled trial with binary outcomes and a small number of clusters

A Potential Outcomes, and Typically More Powerful, Alternative to 'Cochran-Mantel-Haenszel'

Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials

Testing for heterogeneity among the components of a binary composite outcome in a clinical trial

A re-analysis of about 60,000 sparse data meta-analyses suggests that using an adequate method for pooling matters

Novel Methods for the Analysis of Stepped Wedge Cluster Randomized Trials

Random-effects Meta-Analysis of Combined Outcomes Based on Reconstructions of Individual Patient Data

Covariate-constrained randomization in cluster randomized 2 × 2 factorial trials: application to a diabetes prevention study

Leveraging baseline covariates to analyze small cluster-randomized trials with a rare binary outcome

Nonparametric Method for Clustered Data in Pre-Post Factorial Design

Methods to adjust for multiple comparisons in the analysis and sample size calculation of randomised controlled trials with multiple primary outcomes

Model-based optimal randomization procedure for treatment–covariate interaction tests

Bayesian meta-analysis for evaluating treatment effectiveness in biomarker subgroups using trials of mixed patient populations