Abstract:Statistical Methods in Medical Research, Ahead of Print. Linear mixed models are commonly used in analyzing stepped-wedge cluster randomized trials. A key consideration for analyzing a stepped-wedge cluster randomized trial is accounting for the potentially complex correlation structure, which can be achieved by specifying random-effects. The simplest random effects structure is random intercept but more complex structures such as random cluster-by-period, discrete-time decay, and more recently, the random intervention structure, have been proposed. Specifying appropriate random effects in practice can be challenging: assuming more complex correlation structures may be reasonable but they are vulnerable to computational challenges. To circumvent these challenges, robust variance estimators may be applied to linear mixed models to provide consistent estimators of standard errors of fixed effect parameters in the presence of random-effects misspecification. However, there has been no empirical investigation of robust variance estimators for stepped-wedge cluster randomized trials. In this article, we review six robust variance estimators (both standard and small-sample bias-corrected robust variance estimators) that are available for linear mixed models in R, and then describe a comprehensive simulation study to examine the performance of these robust variance estimators for stepped-wedge cluster randomized trials with a continuous outcome under different data generators. For each data generator, we investigate whether the use of a robust variance estimator with either the random intercept model or the random cluster-by-period model is sufficient to provide valid statistical inference for fixed effect parameters, when these working models are subject to random-effect misspecification. Our results indicate that the random intercept and random cluster-by-period models with robust variance estimators performed adequately. The CR3 robust variance estimator (approximate jackknife) estimator, coupled with the number of clusters minus two degrees of freedom correction, consistently gave the best coverage results, but could be slightly conservative when the number of clusters was below 16. We summarize the implications of our results for the linear mixed model analysis of stepped-wedge cluster randomized trials and offer some practical recommendations on the choice of the analytic model.

Jackknife inference with two-way clustering

Fast and Reliable Jackknife and Bootstrap Methods for Cluster‐Robust Inference

Cluster-robust jackknife and bootstrap inference for binary response models

Wild Bootstrap and Asymptotic Inference With Multiway Clustering

Leverage, Influence, and the Jackknife in Clustered Regression Models: Reliable Inference Using summclust

Testing for the appropriate level of clustering in linear regression models

Model-based Inference for Two-Stage Cluster Samples Subject to Nonignorable Item Nonresponse

Determining Individual or Time Effects in Panel Data Models

Standard errors for two-way clustering with serially correlated time effects

Cluster-Robust Bootstrap Inference in Quantile Regression Models

Reliable Wild Bootstrap Inference with Multiway Clustering

Two-Way Cluster-Robust Standard Errors—A Methodological Note on What Has Been Done and What Has Not Been Done in Accounting and Finance Research

Evaluating two small-sample corrections for fixed-effects standard errors and inferences in multilevel models with heteroscedastic, unbalanced, clustered data

Fixed-b Asymptotics for Panel Models with Two-Way Clustering

Predictive inference with the jackknife+

When is it worthwhile to jackknife? Breaking the quadratic barrier for Z-estimators

Multidimensional clustering in judge designs

Doubly Robust Kernel Statistics for Testing Distributional Treatment Effects

A Ridge-Regularized Jackknifed Anderson-Rubin Test

Maintaining the validity of inference from linear mixed models in stepped-wedge cluster randomized trials under misspecified random-effects structures

Jackknife covariance matrix estimation for observations from mixture