Abstract:Exploratory factor analyses are commonly used to determine the underlying factors of multiple observed variables. Many criteria have been suggested to determine how many factors should be retained. In this study, we present an extensive Monte Carlo simulation to investigate the performance of extraction criteria under varying sample sizes, numbers of indicators per factor, loading magnitudes, underlying multivariate distributions of observed variables, as well as how the performance of the extraction criteria are influenced by the presence of cross-loadings and minor factors for unidimensional, orthogonal, and correlated factor models. We compared several variants of traditional parallel analysis (PA), the Kaiser-Guttman Criterion, and sequential χ2 model tests (SMT) with 4 recently suggested methods: revised PA, comparison data (CD), the Hull method, and the Empirical Kaiser Criterion (EKC). No single extraction criterion performed best for every factor model. In unidimensional and orthogonal models, traditional PA, EKC, and Hull consistently displayed high hit rates even in small samples. Models with correlated factors were more challenging, where CD and SMT outperformed other methods, especially for shorter scales. Whereas the presence of cross-loadings generally increased accuracy, non-normality had virtually no effect on most criteria. We suggest researchers use a combination of SMT and either Hull, the EKC, or traditional PA, because the number of factors was almost always correctly retrieved if those methods converged. When the results of this combination rule are inconclusive, traditional PA, CD, and the EKC performed comparatively well. However, disagreement also suggests that factors will be harder to detect, increasing sample size requirements to N ≥ 500. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

A Testing Procedure for Determining the Number of Factors in Approximate Factor Models With Large Datasets

A Multi-Step Procedure to Determine the Number of Factors in Large Approximate Factor Models

Identifying Observed Factors in Approximate Factor Models: Estimation and Hypothesis Testing

How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions.

A Randomized Sequential Procedure to Determine the Number of Factors

A criterion for the number of factors

Simultaneous Inference For High-Dimensional Approximate Factor Model

One model to rule them all? Using machine learning algorithms to determine the number of factors in exploratory factor analysis.

Selecting the number of factors in multi‐variate time series

Determining the number of factors in a large-dimensional generalised factor model

Robust Multiple Testing under High-dimensional Dynamic Factor Model

Econometric Analysis of Large Factor Models

Robust Factor Number Specification for Large-Dimensional Elliptical Factor Model.

Transformed contribution ratio test for the number of factors in static approximate factor models

Testing for Structural Changes in Large Dimensional Factor Models via Discrete Fourier Transform

Comparison of the K1 Rule, Parallel Analysis, and the Bass-Ackward Method on Identifying the Number of Factors in Factor Analysis

Model-Selection-Based Approaches to Identifying the Optimal Number of Factors in Multilevel Exploratory Factor Analysis

Identifying the Number of Factors from Singular Values of A Large Sample Auto-Covariance Matrix

Detecting Big Structural Breaks in Large Factor Models

Optimal Estimation of Large-Dimensional Nonlinear Factor Models

Averaged Chain Substitution Method – Applicability, Advantages, and Disadvantages