Abstract:Statistical Methods in Medical Research, Ahead of Print. Linear mixed models are commonly used in analyzing stepped-wedge cluster randomized trials. A key consideration for analyzing a stepped-wedge cluster randomized trial is accounting for the potentially complex correlation structure, which can be achieved by specifying random-effects. The simplest random effects structure is random intercept but more complex structures such as random cluster-by-period, discrete-time decay, and more recently, the random intervention structure, have been proposed. Specifying appropriate random effects in practice can be challenging: assuming more complex correlation structures may be reasonable but they are vulnerable to computational challenges. To circumvent these challenges, robust variance estimators may be applied to linear mixed models to provide consistent estimators of standard errors of fixed effect parameters in the presence of random-effects misspecification. However, there has been no empirical investigation of robust variance estimators for stepped-wedge cluster randomized trials. In this article, we review six robust variance estimators (both standard and small-sample bias-corrected robust variance estimators) that are available for linear mixed models in R, and then describe a comprehensive simulation study to examine the performance of these robust variance estimators for stepped-wedge cluster randomized trials with a continuous outcome under different data generators. For each data generator, we investigate whether the use of a robust variance estimator with either the random intercept model or the random cluster-by-period model is sufficient to provide valid statistical inference for fixed effect parameters, when these working models are subject to random-effect misspecification. Our results indicate that the random intercept and random cluster-by-period models with robust variance estimators performed adequately. The CR3 robust variance estimator (approximate jackknife) estimator, coupled with the number of clusters minus two degrees of freedom correction, consistently gave the best coverage results, but could be slightly conservative when the number of clusters was below 16. We summarize the implications of our results for the linear mixed model analysis of stepped-wedge cluster randomized trials and offer some practical recommendations on the choice of the analytic model.

Comparison of Software Algorithms for Calculating Reml Wald Type Confidence Limits for the Between-Group Variance Component in A Small Sample One-Way Random Effects Model Example

A Comparison of REML and Bayesian Estimation of Variance Components for Unbalanced One-way Random Effects Models With Small Sample Sizes

A comparison of recent approaches to the analysis of repeated measurements

Closed-form REML estimators and sample size determination for mixed effects models for repeated measures under monotone missingness

Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials

Differences of Type I error rates for ANOVA and Multilevel-Linear-Models using SAS and SPSS for repeated measures designs

Evaluating the robustness of repeated measures analyses: The case of small sample sizes and nonnormal data

A Practical Approach for Comparing Means of Two Groups Without Equal Variance Assumption

Maintaining the validity of inference from linear mixed models in stepped-wedge cluster randomized trials under misspecified random-effects structures

High-dimensional genome-wide association study and misspecified mixed model analysis

Evaluating two small-sample corrections for fixed-effects standard errors and inferences in multilevel models with heteroscedastic, unbalanced, clustered data

A comparison of methods for the analysis of binomial proportion data in behavioral research

Simultaneous confidence intervals for pairwise multiple comparisons in a two-way unbalanced design with unequal variances

A Monte Carlo Study of the Effects of Common Method Variance on Significance Testing and Parameter Bias in Hierarchical Linear Modeling

Multiple Comparisons of Treatment Against Control under Unequal Variances Using Parametric Bootstrap

Small sample adjustment for inference without assuming orthogonality in a mixed model for repeated measures analysis

Testing against ordered alternatives in one-way ANOVA model with exponential errors

Review of sample size determination methods for the intraclass correlation coefficient in the one-way analysis of variance model

Comparison of Different Methods for Analyzing Data Obtained from Stratified Cluster Random Sampling

Valid predictions of random quantities in linear mixed models

Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation