Abstract:The premise in experiments with repeated measures is that observations taken in the same experimental unit are correlated and that correlations decrease proportionally to the increase in the distance between measurements in time or space. Nevertheless, these experiments are often analyzed as if the correlations between the repeated measures were constant or using methods that only consider correlations different, which may impact on the rejection rate of the null hypothesis, and ultimately type I error rate and statistical power. In this context, this study investigated the application of mixed linear models with different assumptions about the covariance matrix in data sets from simulated experiments with repeated measures. 84 scenarios that varied in terms of the covariance matrix pattern (14 structures), number of repeated measurements (4 and 8) and sample size (4, 8 and 12) were evaluated. 10,000 data sets were simulated for each scenario based on a multivariate normal distribution and were subsequently analyzed using mixed linear models. Type I error rate and statistical power for the hypothesis test of the interaction between treatments and repeated measures were estimated as the proportion of p values less than or equal to 0.01 or 0.05 out of a total of 10,000 tests for each scenario. The models were also evaluated for their ability to fit the data using Bayesian Information Criteria (BIC). Thus, the frequency with which the covariance structures were chosen by the selection criteria was computed. Results indicate that the assumption chosen most frequently by the information criteria resulted from the specified covariance structure that corresponded to the empirical covariance structure of the analyzed data sets, particularly for those with larger number of repeated measures and sample sizes. Results also indicate that the use of covariance models that do not recognize heterogeneous correlations between repeated measures can inflate type I error or reduce it to very conservative levels, which may affect the conclusion of agricultural experiments. For a 5% significance level, type I error bias was greater than 2α, while for 1% significance level, bias was over 5α. In addition, the statistical power was reduced when the assumption about the covariance matrix of the data sets did not correspond to the empirical covariance structure, particularly for those data sets with a smaller sample size.

Pairwise deletion for missing data in structural equation models: Nonpositive definite matrices, parameter estimates, goodness of fit, and adjusted sample sizes

Modeling of Correlated Cognitive Function and Functional Disability Outcomes with Bounded and Missing Data in a Longitudinal Aging Study

Simulation-Based Performance Evaluation of Missing Data Handling in Network Analysis

Inverse Probability-Weighted Estimation for Dynamic Structural Equation Model with Missing Data

The More Data, the Better? Demystifying Deletion-Based Methods in Linear Regression with Missing Data

Parametric Models of Covariance Matrices for Repeated Measures: A Simulation Study on Fit, Error and Statistical Power in Mixed Linear Models

Biases in SPSS 12.0 Missing Value Analysis

Performance of Model Fit and Selection Indices for Bayesian Structural Equation Modeling with Missing Data

Dealing with missing data in multi-informant studies: A comparison of approaches

The Effect of Missing Item Data on the Relative Predictive Accuracy of Correctional Risk Assessment Tools

Tests of Missing Completely At Random based on sample covariance matrices

Propensity Score Weighting with Missing Data on Covariates and Clustered Data Structure

A Simulation Study of Polychoric Instrumental Variable Estimation in Structural Equation Models

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

Entrywise Inference for Missing Panel Data: A Simple and Instance-Optimal Approach

The Bias and Efficiency of Incomplete-Data Estimators in Small Univariate Normal Samples

MMD Two-sample Testing in the Presence of Arbitrarily Missing Data

Maximum likelihood estimation of missing data probability for nonmonotone missing at random data

Dynamic Structural Equation Models with Missing Data: Data Requirements on N and T

Multiple imputation for missing data: fully conditional specification versus multivariate normal imputation

Likelihood ratio tests under model misspecification in high dimensions