Abstract:OBJECTIVE: The aims of this study were to describe how repeated-measures analysis of variance (ANOVA) and the hierarchical linear model (HLM) are used to evaluate intervention effect and to compare these methods, especially in relation to their requirements regarding assumptions, number of repeated measures, completeness of repeated measures, and equal intervals between measurements.APPROACH: Alzheimer's Disease Assessment Scale (ADAS) data sets (101 residents in 14 nursing homes, five times) were analyzed to explain differences between repeated-measures ANOVA and the HLM.RESULTS: More detailed information is available when HLM is used. For example, repeated-measures ANOVA showed that there is a statistically significant difference on overall mean ADAS scores between the married and nonmarried groups. The HLM analysis showed more detailed information; the ADAS score of the married group was higher by 6.4 than that of the nonmarried group on the adjusted average ADAS scores (during the whole data collection period). Repeated-measures ANOVA does not provide results on the within-subject changes with days. The HLM provides the specific conclusion that ADAS scores were increased by the one unit of "days" variable (0.017) when days were included.DISCUSSION: Hierarchical linear model is a powerful statistical method that can be applied to longitudinal research to evaluate an intervention at multiple levels. The major differences between the repeated-measures ANOVA and the HLM can be summarized as follows: The HLM (a) has less strict assumptions, (b) has more flexible data requirements (dealing with the missing data), and (c) stresses individual change over group differences. More stringent assumptions should be satisfied in repeated-measures ANOVA than in the HLM. The HLM may resolve important statistical issues that have existed in repeated-measures ANOVA. The HLM has more flexible data requirements in that it (a) can be utilized when the measurement data collection points are unequal and (b) may be used when researchers do not have data for all follow-up points, whereas the repeated-measures ANOVA requires a fixed time series design (equal interval, equal number of time points).

Discussion of Main Effect in Repeated Measures ANOVA

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

The Analysis of Repeated Measures Designs Involving Multiple Dependent Variables

The analysis of repeated measures designs: A review

A Comparison of the General Linear Mixed Model and Repeated Measures ANOVA Using a Dataset with Multiple Missing Data Points

Repeated-measure analyses: Which one? A survey of statistical models and recommendations for reporting

Application of Repeated-Measures Analysis of Variance and Hierarchical Linear Model in Nursing Research

Statistical analyses of repeated measures in physiological research: a tutorial

Use of Repeated Measures Data Analysis for Field Trials with Annual and Perennial Crops

Repeated Measures ANOVA with Latent Variables to Analyze Interindividual Differences in Contrasts

On the Ambiguity of Interaction and Nonlinear Main Effects in a Regime of Dependent Covariates

A comparison of recent approaches to the analysis of repeated measurements

MANOVA method for analyzing repeated measures designs: An extensive primer.

Understanding Factorial Designs, Main Effects, and Interaction Effects: Simply Explained with a Worked Example

Mixed Model Applications to the Analysis of Repeated Measures Data in Clinical Trials

Analysis of variance for repeated measures designs: Two approaches.

Challenges in interpreting results from ‘multiple regression’ when there is interaction between covariates

On Nonparametric Repeated Measures Analysis of Variance

A Marginal Effects Approach to Interpreting Main Effects and Moderation

Analysis of variance for repeated measures data: A generalized estimating equations approach