Abstract:Investigators often conduct randomized controlled trials (RCTs) at multiple centers/sites when determining the effect of a treatment or an intervention. Diversifying recruitment across multiple institutions allows investigators to make recruitment go faster within a shorter timeframe and allows generalizing the study results across diverse populations. Despite having a common study protocol across multiple centers, the eligible participants may be heterogeneous, site policies and practices may vary, and the investigators' experience, training, and expertise may also vary across sites. These factors may contribute to the heterogeneity in effect estimates across centers. As a result, we usually observe some degree of heterogeneity in effect estimates across centers, despite all centers following the same study protocol. During the analysis of such a trial, investigators typically ignore center effects, but some have suggested considering centers as fixed or random effects in the model. It is not clear how considering the effects of centers, either as fixed or random effects, impacts the test of the primary hypothesis. In this article, we first review the practice of accounting for center effects in the analyses of published RCTs and illustrate the extent of heterogeneity observed in a few preexisting multicenter RCTs. To determine the impact of heterogeneity on the test of a primary hypothesis of an RCT, we considered continuous and binary outcomes and the corresponding appropriate model, namely, a simple linear regression model for a continuous outcome and a logistic regression model for the binary outcome. For each model type, we considered three methods: (a) ignore the center effect, (b) account for centers as fixed effects, or (c) account for centers as random effects. Based on simulation studies of these models, we then examine whether considering the center as a fixed or random effect in the model helps to preserve or reduce the type I and type II error rates during the analysis phase of an RCT. Finally, we outline the threshold at which center-level effects are negligible and thus negligible and provide recommendations on when it may be necessary to account for center effects during the analyses of multicenter randomized controlled trials.

The fixed versus random effects debate and how it relates to centering in multilevel modeling.

Accounting for center-level effects in multicenter randomized controlled trials

Students Are Rarely Independent: When, Why, and How to Use Random Effects in Discipline-Based Education Research

Multilevel modeling for longitudinal data: concepts and applications

Evaluating two small-sample corrections for fixed-effects standard errors and inferences in multilevel models with heteroscedastic, unbalanced, clustered data

On the Importance of Considering Concurrent Effects in Random-Intercept Cross-Lagged Panel Modelling: Example Analysis of Bullying and Internalising Problems

A simple, robust test for choosing the level of fixed effects in linear panel data models

A 3-level Bayesian mixed effects location scale model with an application to ecological momentary assessment data.

A structural equation modeling approach for modeling variability as a latent variable.

Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations.

Let’s Talk About Fixed Effects: Let’s Talk About All the Good Things and the Bad Things

Investigating Moderation Effects at the Within-Person Level Using Intensive Longitudinal Data: A Two-Level Dynamic Structural Equation Modelling Approach in Mplus

Panel data models with nonadditive unobserved heterogeneity: Estimation and inference

Varying Responses to Common Shocks and Complex Cross-Sectional Dependence: Dynamic Multilevel Modeling with Multifactor Error Structures for Time-Series Cross-Sectional Data

How to model and interpret cross-lagged effects in psychotherapy mechanisms of change research: A comparison of multilevel and structural equation models.

Three Extensions of the Random Intercept Cross-Lagged Panel Model

Fixed Effects Testing in High-Dimensional Linear Mixed Models

Estimating nonlinear effects of random slopes: A comparison of multilevel structural equation modeling with a two-step, a single-indicator, and a plausible values approach

Randomized Experiments in Education, with Implications for Multilevel Causal Inference

Model Specification in Mixed-Effects Models: A Focus on Random Effects

Randomization inference for treatment effect variation