Abstract:Exploratory factor analyses are commonly used to determine the underlying factors of multiple observed variables. Many criteria have been suggested to determine how many factors should be retained. In this study, we present an extensive Monte Carlo simulation to investigate the performance of extraction criteria under varying sample sizes, numbers of indicators per factor, loading magnitudes, underlying multivariate distributions of observed variables, as well as how the performance of the extraction criteria are influenced by the presence of cross-loadings and minor factors for unidimensional, orthogonal, and correlated factor models. We compared several variants of traditional parallel analysis (PA), the Kaiser-Guttman Criterion, and sequential χ2 model tests (SMT) with 4 recently suggested methods: revised PA, comparison data (CD), the Hull method, and the Empirical Kaiser Criterion (EKC). No single extraction criterion performed best for every factor model. In unidimensional and orthogonal models, traditional PA, EKC, and Hull consistently displayed high hit rates even in small samples. Models with correlated factors were more challenging, where CD and SMT outperformed other methods, especially for shorter scales. Whereas the presence of cross-loadings generally increased accuracy, non-normality had virtually no effect on most criteria. We suggest researchers use a combination of SMT and either Hull, the EKC, or traditional PA, because the number of factors was almost always correctly retrieved if those methods converged. When the results of this combination rule are inconclusive, traditional PA, CD, and the EKC performed comparatively well. However, disagreement also suggests that factors will be harder to detect, increasing sample size requirements to N ≥ 500. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The Quality of Factor Solutions in Exploratory Factor Analysis: The Influence of Sample Size, Communality, and Overdetermination

Minimizing Sample Size When Using Exploratory Factor Analysis for Measurement

How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions.

A Testing Procedure for Determining the Number of Factors in Approximate Factor Models With Large Datasets

Local minima and factor rotations in exploratory factor analysis.

Exploratory Factor Analysis With Small Sample Sizes

One Size Doesn’t Fit All: Using Factor Analysis to Gather Validity Evidence When Using Surveys in Your Research

Exploratory factor analysis: Current use, methodological developments and recommendations for good practice

Are the Signs of Factor Loadings Arbitrary in Confirmatory Factor Analysis? Problems and Solutions

Exact Exploratory Bi-factor Analysis: A Constraint-based Optimisation Approach

Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis

Model-Selection-Based Approaches to Identifying the Optimal Number of Factors in Multilevel Exploratory Factor Analysis

One model to rule them all? Using machine learning algorithms to determine the number of factors in exploratory factor analysis.

Improving the Use of Parallel Analysis by Accounting for Sampling Variability of the Observed Correlation Matrix

Identifying Observed Factors in Approximate Factor Models: Estimation and Hypothesis Testing

Factor analysis in the development and refinement of clinical assessment instruments.

A Note on the Likelihood Ratio Test in High-Dimensional Exploratory Factor Analysis

A Perspective on the Mathematical and Psychometric Aspects of Factor Indeterminacy

Finiteness of small factor analysis models

Measurement of quality in preschool child care classrooms: An exploratory and confirmatory factor analysis of the early childhood environment rating scale-revised

Comparison of the K1 Rule, Parallel Analysis, and the Bass-Ackward Method on Identifying the Number of Factors in Factor Analysis