Abstract:Statistical Methods in Medical Research, Ahead of Print. Linear mixed models are commonly used in analyzing stepped-wedge cluster randomized trials. A key consideration for analyzing a stepped-wedge cluster randomized trial is accounting for the potentially complex correlation structure, which can be achieved by specifying random-effects. The simplest random effects structure is random intercept but more complex structures such as random cluster-by-period, discrete-time decay, and more recently, the random intervention structure, have been proposed. Specifying appropriate random effects in practice can be challenging: assuming more complex correlation structures may be reasonable but they are vulnerable to computational challenges. To circumvent these challenges, robust variance estimators may be applied to linear mixed models to provide consistent estimators of standard errors of fixed effect parameters in the presence of random-effects misspecification. However, there has been no empirical investigation of robust variance estimators for stepped-wedge cluster randomized trials. In this article, we review six robust variance estimators (both standard and small-sample bias-corrected robust variance estimators) that are available for linear mixed models in R, and then describe a comprehensive simulation study to examine the performance of these robust variance estimators for stepped-wedge cluster randomized trials with a continuous outcome under different data generators. For each data generator, we investigate whether the use of a robust variance estimator with either the random intercept model or the random cluster-by-period model is sufficient to provide valid statistical inference for fixed effect parameters, when these working models are subject to random-effect misspecification. Our results indicate that the random intercept and random cluster-by-period models with robust variance estimators performed adequately. The CR3 robust variance estimator (approximate jackknife) estimator, coupled with the number of clusters minus two degrees of freedom correction, consistently gave the best coverage results, but could be slightly conservative when the number of clusters was below 16. We summarize the implications of our results for the linear mixed model analysis of stepped-wedge cluster randomized trials and offer some practical recommendations on the choice of the analytic model.

Sample Size and Robust Marginal Methods for Cluster-Randomized Trials with Censored Event Times.

Improving sandwich variance estimation for marginal Cox analysis of cluster randomized trials

Sample size considerations for stratified cluster randomization design with binary outcomes and varying cluster size

Sample size estimation for modified Poisson analysis of cluster randomized trials with a binary outcome

Semiparametric recurrent event vs time-to-first-event analyses in randomized trials: Estimands and model misspecification

Sample Size Calculation for Cluster Randomized Trials with Zero-inflated Count Outcomes

Methods for sample size determination in cluster randomized trials

Sample size calculation for treatment effects in randomized trials with fixed cluster sizes and heterogeneous intraclass correlations and variances

The fixed-effects model for robust analysis of stepped-wedge cluster trials with a small number of clusters and continuous outcomes: a simulation study

How to design efficient cluster randomised trials

Marginal modeling of cluster-period means and intraclass correlations in stepped wedge designs with binary outcomes

Comparison of tests for categorical data from a stratified cluster randomized trial

Conformal causal inference for cluster randomized trials: model-robust inference without asymptotic approximations

Leveraging baseline covariates to analyze small cluster-randomized trials with a rare binary outcome

Sample size considerations for matched‐pair cluster randomization design with incomplete observations of binary outcomes

Semiparametric Regression Analysis of Clustered Interval-Censored Failure Time Data with Informative Cluster Size

Handling incomplete outcomes and covariates in cluster-randomized trials: doubly-robust estimation, efficiency considerations, and sensitivity analysis

The effect of number of clusters and magnitude of within‐cluster homogeneity in outcomes on the performance of four variance estimators for a marginal multivariable Cox regression model fit to clustered data in the context of observational research

Sample size requirements for testing treatment effect heterogeneity in cluster randomized trials with binary outcomes

Regression Analysis of Clustered Interval-Censored Failure Time Data with Cure Fraction and Informative Cluster Size

Maintaining the validity of inference from linear mixed models in stepped-wedge cluster randomized trials under misspecified random-effects structures