Abstract:Analysis of variance (ANOVA) is widely used to assess the influence of one or more experimental (or quasi-experimental) manipulations on a continuous outcome. Traditionally, ANOVA is carried out in a frequentist manner using p values, but a Bayesian alternative has been proposed. Assuming that the proposed Bayesian ANOVA is closely modeled after its frequentist counterpart, one may be surprised to find that the two can yield very different conclusions when the design involves multiple repeated-measures factors. We illustrate such a discrepancy with a real data set from a two-factorial within-subject experiment. For this data set, the results of a frequentist and Bayesian ANOVA are in a disagreement about which main effect accounts for the variance in the data. The reason for this disagreement is that frequentist and the proposed Bayesian ANOVA use different model specifications. As currently implemented, the proposed Bayesian ANOVA assumes that there are no individual differences in the magnitude of effects. We suspect that this assumption is neither obvious to nor desired by most analysts because it is untenable in most applications. We argue here that the Bayesian ANOVA should be revised to allow for individual differences. As a default, we suggest the standard frequentist model specification but discuss a recently proposed alternative and provide guidance on how to choose the appropriate model specification. We end by discussing the implications of the revised model specification for previously published results of Bayesian ANOVAs.

Modification of Factor Analysis Models in Covariance Structure Analysis a Monte Carlo Study

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

Model-Selection-Based Approaches to Identifying the Optimal Number of Factors in Multilevel Exploratory Factor Analysis

TESTING FOR STRUCTURAL CHANGES IN FACTOR MODELS VIA A NONPARAMETRIC REGRESSION

On Time-Varying Factor Models: Estimation and Testing

Improving measurement-invariance assessments: correcting entrenched testing deficiencies

Estimating and Testing High Dimensional Factor Models With Multiple Structural Changes

EIGENVALUE DISTRIBUTIONS OF VARIANCE COMPONENTS ESTIMATORS IN HIGH-DIMENSIONAL RANDOM EFFECTS MODELS

A modification of Cheng'S method: An alternative Factor Screening method for stochastic simulation models

Structural Changes in High Dimensional Factor Models

A Robust Residual-Based Test for Structural Changes in Factor Models

Make Some Noise: Generating Data from Imperfect Factor Models

Factor models and variable selection in high-dimensional regression analysis

Coefficients of factor score determinacy for mean plausible values of Bayesian factor analysis

Sequential testing for structural stability in approximate factor models

Score predictor factor analysis: Reproducing observed covariances by means of factor score predictors

Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation

A Monte Carlo Study of the Effects of Common Method Variance on Significance Testing and Parameter Bias in Hierarchical Linear Modeling

Bayesian Repeated-Measures Analysis of Variance: An Updated Methodology Implemented in JASP

Are the Signs of Factor Loadings Arbitrary in Confirmatory Factor Analysis? Problems and Solutions