Abstract:Statistical Methods in Medical Research, Ahead of Print. Linear mixed models are commonly used in analyzing stepped-wedge cluster randomized trials. A key consideration for analyzing a stepped-wedge cluster randomized trial is accounting for the potentially complex correlation structure, which can be achieved by specifying random-effects. The simplest random effects structure is random intercept but more complex structures such as random cluster-by-period, discrete-time decay, and more recently, the random intervention structure, have been proposed. Specifying appropriate random effects in practice can be challenging: assuming more complex correlation structures may be reasonable but they are vulnerable to computational challenges. To circumvent these challenges, robust variance estimators may be applied to linear mixed models to provide consistent estimators of standard errors of fixed effect parameters in the presence of random-effects misspecification. However, there has been no empirical investigation of robust variance estimators for stepped-wedge cluster randomized trials. In this article, we review six robust variance estimators (both standard and small-sample bias-corrected robust variance estimators) that are available for linear mixed models in R, and then describe a comprehensive simulation study to examine the performance of these robust variance estimators for stepped-wedge cluster randomized trials with a continuous outcome under different data generators. For each data generator, we investigate whether the use of a robust variance estimator with either the random intercept model or the random cluster-by-period model is sufficient to provide valid statistical inference for fixed effect parameters, when these working models are subject to random-effect misspecification. Our results indicate that the random intercept and random cluster-by-period models with robust variance estimators performed adequately. The CR3 robust variance estimator (approximate jackknife) estimator, coupled with the number of clusters minus two degrees of freedom correction, consistently gave the best coverage results, but could be slightly conservative when the number of clusters was below 16. We summarize the implications of our results for the linear mixed model analysis of stepped-wedge cluster randomized trials and offer some practical recommendations on the choice of the analytic model.

Fast and Reliable Jackknife and Bootstrap Methods for Cluster‐Robust Inference

Cluster-robust jackknife and bootstrap inference for binary response models

Cluster-Robust Bootstrap Inference in Quantile Regression Models

Jackknife inference with two-way clustering

Wild Bootstrap and Asymptotic Inference With Multiway Clustering

Leverage, Influence, and the Jackknife in Clustered Regression Models: Reliable Inference Using summclust

Wild bootstrap inference for penalized quantile regression for longitudinal data

Testing for the appropriate level of clustering in linear regression models

Reliable Wild Bootstrap Inference with Multiway Clustering

Predictive inference with the jackknife+

A Higher-Order Swiss Army Infinitesimal Jackknife

When is it worthwhile to jackknife? Breaking the quadratic barrier for Z-estimators

The Bayesian Infinitesimal Jackknife for Variance

A Comparison of Resampling and Recursive Partitioning Methods in Random Forest for Estimating the Asymptotic Variance Using the Infinitesimal Jackknife

Bootstrapping the Cross-Validation Estimate

Maintaining the validity of inference from linear mixed models in stepped-wedge cluster randomized trials under misspecified random-effects structures

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

Bootstrapping for multivariate linear regression models

How cluster‐robust inference is changing applied econometrics

Cluster-robust inference: A guide to empirical practice

A novel bootstrap goodness-of-fit test for normal linear regression models