Abstract:The premise in experiments with repeated measures is that observations taken in the same experimental unit are correlated and that correlations decrease proportionally to the increase in the distance between measurements in time or space. Nevertheless, these experiments are often analyzed as if the correlations between the repeated measures were constant or using methods that only consider correlations different, which may impact on the rejection rate of the null hypothesis, and ultimately type I error rate and statistical power. In this context, this study investigated the application of mixed linear models with different assumptions about the covariance matrix in data sets from simulated experiments with repeated measures. 84 scenarios that varied in terms of the covariance matrix pattern (14 structures), number of repeated measurements (4 and 8) and sample size (4, 8 and 12) were evaluated. 10,000 data sets were simulated for each scenario based on a multivariate normal distribution and were subsequently analyzed using mixed linear models. Type I error rate and statistical power for the hypothesis test of the interaction between treatments and repeated measures were estimated as the proportion of p values less than or equal to 0.01 or 0.05 out of a total of 10,000 tests for each scenario. The models were also evaluated for their ability to fit the data using Bayesian Information Criteria (BIC). Thus, the frequency with which the covariance structures were chosen by the selection criteria was computed. Results indicate that the assumption chosen most frequently by the information criteria resulted from the specified covariance structure that corresponded to the empirical covariance structure of the analyzed data sets, particularly for those with larger number of repeated measures and sample sizes. Results also indicate that the use of covariance models that do not recognize heterogeneous correlations between repeated measures can inflate type I error or reduce it to very conservative levels, which may affect the conclusion of agricultural experiments. For a 5% significance level, type I error bias was greater than 2α, while for 1% significance level, bias was over 5α. In addition, the statistical power was reduced when the assumption about the covariance matrix of the data sets did not correspond to the empirical covariance structure, particularly for those data sets with a smaller sample size.

A simulation study on tests of hypotheses and confidence intervals for fixed effects in mixed models for blocked experiments with missing data

Comparison of Software Algorithms for Calculating Reml Wald Type Confidence Limits for the Between-Group Variance Component in A Small Sample One-Way Random Effects Model Example

Inference for Repeated Measures Models under Heteroscedasticity

Parametric Models of Covariance Matrices for Repeated Measures: A Simulation Study on Fit, Error and Statistical Power in Mixed Linear Models

Evaluating two small-sample corrections for fixed-effects standard errors and inferences in multilevel models with heteroscedastic, unbalanced, clustered data

A comparison of recent approaches to the analysis of repeated measurements

Valid predictions of random quantities in linear mixed models

Analysis of Unbalanced Data by Mixed Linear Models Using the MIXED Procedure of the SAS System

Evaluating the robustness of repeated measures analyses: The case of small sample sizes and nonnormal data

Maintaining the validity of inference from linear mixed models in stepped-wedge cluster randomized trials under misspecified random-effects structures

A Comparison of REML and Bayesian Estimation of Variance Components for Unbalanced One-way Random Effects Models With Small Sample Sizes

Robust Confidence Intervals for Meta-Regression with Interaction Effects

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

Differences of Type I error rates for ANOVA and Multilevel-Linear-Models using SAS and SPSS for repeated measures designs

Closed-form REML estimators and sample size determination for mixed effects models for repeated measures under monotone missingness

Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials

Fixed Effects Testing in High-Dimensional Linear Mixed Models

Comparison of random‐effects meta‐analysis models for the relative risk in the case of rare events: A simulation study

A more powerful test method for analyzing unreplicated factorial two-level experiments

Wild Bootstrapping Rank-Based Procedures: Multiple Testing in Nonparametric Split-Plot Designs

Exploration of the MCMC Wald test with linear regression