Abstract:OBJECTIVE: The aims of this study were to describe how repeated-measures analysis of variance (ANOVA) and the hierarchical linear model (HLM) are used to evaluate intervention effect and to compare these methods, especially in relation to their requirements regarding assumptions, number of repeated measures, completeness of repeated measures, and equal intervals between measurements.APPROACH: Alzheimer's Disease Assessment Scale (ADAS) data sets (101 residents in 14 nursing homes, five times) were analyzed to explain differences between repeated-measures ANOVA and the HLM.RESULTS: More detailed information is available when HLM is used. For example, repeated-measures ANOVA showed that there is a statistically significant difference on overall mean ADAS scores between the married and nonmarried groups. The HLM analysis showed more detailed information; the ADAS score of the married group was higher by 6.4 than that of the nonmarried group on the adjusted average ADAS scores (during the whole data collection period). Repeated-measures ANOVA does not provide results on the within-subject changes with days. The HLM provides the specific conclusion that ADAS scores were increased by the one unit of "days" variable (0.017) when days were included.DISCUSSION: Hierarchical linear model is a powerful statistical method that can be applied to longitudinal research to evaluate an intervention at multiple levels. The major differences between the repeated-measures ANOVA and the HLM can be summarized as follows: The HLM (a) has less strict assumptions, (b) has more flexible data requirements (dealing with the missing data), and (c) stresses individual change over group differences. More stringent assumptions should be satisfied in repeated-measures ANOVA than in the HLM. The HLM may resolve important statistical issues that have existed in repeated-measures ANOVA. The HLM has more flexible data requirements in that it (a) can be utilized when the measurement data collection points are unequal and (b) may be used when researchers do not have data for all follow-up points, whereas the repeated-measures ANOVA requires a fixed time series design (equal interval, equal number of time points).

Chasing Change: Repeated-Measures Analysis of Variance Is So Yesterday!

Longitudinal Analysis in Occupational Health Psychology: A Review and Tutorial of Three Longitudinal Modeling Techniques

Latent Growth Curve and Repeated Measures ANOVA Contrasts: What the Models are Telling You

Selecting a linear mixed model for longitudinal data: Repeated measures analysis of variance, covariance pattern model, and growth curve approaches.

Augmenting Visual Analysis in Single-Case Research With Hierarchical Linear Modeling

Repeated-measure analyses: Which one? A survey of statistical models and recommendations for reporting

Application of Repeated-Measures Analysis of Variance and Hierarchical Linear Model in Nursing Research

Mastering the Use of Control Variables: the Hierarchical Iterative Control (HIC) Approach

A comparison of recent approaches to the analysis of repeated measurements

Missing not at random models for latent growth curve analyses.

IV. DEVELOPMENTS IN THE ANALYSIS OF LONGITUDINAL DATA

Repeated Measures ANOVA with Latent Variables to Analyze Interindividual Differences in Contrasts

Statistical analyses of repeated measures in physiological research: a tutorial

Bayesian Repeated-Measures Analysis of Variance: An Updated Methodology Implemented in JASP

Measurement Models, Estimation, and the Study of Change

Longitudinal modeling in developmental neuroimaging research: Common challenges, and solutions from developmental psychology

Understanding Variation in Longitudinal Data Using Latent Growth Mixture Modeling

Modeling Nonlinear Change Via Latent Change and Latent Acceleration Frameworks: Examining Velocity and Acceleration of Growth Trajectories.

Latent growth modeling with domain-specific outcomes comprised of mixed response types in intervention studies.

Using Data Augmentation to Obtain Standard Errors and Conduct Hypothesis Tests in Latent Class and Latent Transition Analysis.