Abstract:Exploratory factor analyses are commonly used to determine the underlying factors of multiple observed variables. Many criteria have been suggested to determine how many factors should be retained. In this study, we present an extensive Monte Carlo simulation to investigate the performance of extraction criteria under varying sample sizes, numbers of indicators per factor, loading magnitudes, underlying multivariate distributions of observed variables, as well as how the performance of the extraction criteria are influenced by the presence of cross-loadings and minor factors for unidimensional, orthogonal, and correlated factor models. We compared several variants of traditional parallel analysis (PA), the Kaiser-Guttman Criterion, and sequential χ2 model tests (SMT) with 4 recently suggested methods: revised PA, comparison data (CD), the Hull method, and the Empirical Kaiser Criterion (EKC). No single extraction criterion performed best for every factor model. In unidimensional and orthogonal models, traditional PA, EKC, and Hull consistently displayed high hit rates even in small samples. Models with correlated factors were more challenging, where CD and SMT outperformed other methods, especially for shorter scales. Whereas the presence of cross-loadings generally increased accuracy, non-normality had virtually no effect on most criteria. We suggest researchers use a combination of SMT and either Hull, the EKC, or traditional PA, because the number of factors was almost always correctly retrieved if those methods converged. When the results of this combination rule are inconclusive, traditional PA, CD, and the EKC performed comparatively well. However, disagreement also suggests that factors will be harder to detect, increasing sample size requirements to N ≥ 500. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Exploratory factor analysis: Current use, methodological developments and recommendations for good practice

Exploratory Factor Analysis (EFA) in Quantitative Researches and Practical Considerations

A systematic review of exploratory factor analysis in marketing: providing recommended guidelines and evaluating current practices

A Methodological Review of Exploratory Factor Analysis in Sexuality Research: Used Practices, Best Practices, and Data Analysis Resources

Exploratory Factor Analysis With Small Sample Sizes

How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions.

Exploratory graph analysis: a new approach for estimating the number of dimensions in psychological research

Factor Analysis in Counseling Research and Practice

Factor analysis in personality disorders research: Modern issues and illustrations of practical recommendations.

One model to rule them all? Using machine learning algorithms to determine the number of factors in exploratory factor analysis.

Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and Set-ESEM: Optimal Balance Between Goodness of Fit and Parsimony

Minimizing Sample Size When Using Exploratory Factor Analysis for Measurement

An Easy Guide to Factor Analysis

Factor analysis in the development and refinement of clinical assessment instruments.

Stochastic Approximation EM for Exploratory Item Factor Analysis

A Model Implied Instrumental Variable Approach to Exploratory Factor Analysis (MIIV-EFA)

Enhancing Interpretability in Factor Analysis by Means of Mathematical Optimization

Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis

Local minima and factor rotations in exploratory factor analysis.

Bifactor exploratory structural equation modeling: A meta-analytic review of model fit