Abstract:The accuracy of factor retention methods for structures with one or more general factors, like the ones typically encountered in fields like intelligence, personality, and psychopathology, has often been overlooked in dimensionality research. To address this issue, we compared the performance of several factor retention methods in this context, including a network psychometrics approach developed in this study. For estimating the number of group factors, these methods were the Kaiser criterion, empirical Kaiser criterion, parallel analysis with principal components (PAPCA) or principal axis, and exploratory graph analysis with Louvain clustering (EGALV). We then estimated the number of general factors using the factor scores of the first-order solution suggested by the best two methods, yielding a "second-order" version of PAPCA (PAPCA-FS) and EGALV (EGALV-FS). Additionally, we examined the direct multilevel solution provided by EGALV. All the methods were evaluated in an extensive simulation manipulating nine variables of interest, including population error. The results indicated that EGALV and PAPCA displayed the best overall performance in retrieving the true number of group factors, the former being more sensitive to high cross-loadings, and the latter to weak group factors and small samples. Regarding the estimation of the number of general factors, both PAPCA-FS and EGALV-FS showed a close to perfect accuracy across all the conditions, while EGALV was inaccurate. The methods based on EGA were robust to the conditions most likely to be encountered in practice. Therefore, we highlight the particular usefulness of EGALV (group factors) and EGALV-FS (general factors) for assessing bifactor structures with multiple general factors. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Dimensionality in confirmatory factor analysis is not in the eye of the beholder: Ancillary bifactor statistical indices illuminate dimensionality and reliability

Factor analysis in the development and refinement of clinical assessment instruments.

Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation

Bifactor exploratory structural equation modeling: A meta-analytic review of model fit

Competing Confirmatory Factor Analysis Models in Management Research: Bifactor Modeling of the Employee Work Assessment Tool

IDENTIFIABILITY OF BIFACTOR MODELS

Improving measurement-invariance assessments: correcting entrenched testing deficiencies

A Perspective on the Mathematical and Psychometric Aspects of Factor Indeterminacy

Dimensionality assessment in bifactor structures with multiple general factors: A network psychometrics approach.

Bifactor Exploratory Structural Equation Models Versus Traditional Approaches in Predicting External Criteria

Assessing the Unidimensionality of Clayton’s Environmental Identity Scale Using Confirmatory Factor Analysis (CFA) and Bifactor Exploratory Structural Equation Modeling (bifactor-ESEM)

Impact of Informative Priors on Model Fit Indices in Bayesian Confirmatory Factor Analysis

Bayesian factor selection in a hybrid approach to confirmatory factor analysis

The Accuracy of Bayesian Model Fit Indices in Selecting Among Multidimensional Item Response Theory Models

Constraints for non-zero secondary loadings in confirmatory factor analysis

Accommodating and Extending Various Models for Special Effects Within the Generalized Partially Confirmatory Factor Analysis Framework

A comprehensive analysis of the factor structure of the Beck Depression Inventory-II in a sample of outpatients with adjustment disorder and depressive episode

Factor Structure and Incremental Validity of the Original and Modified Versions of the Difficulties in Emotion Regulation Scale

Principal Fitted Components for Dimension Reduction in Regression

Dimensionality of narcissism: a Bifactorial model of the Narcissistic Personality Inventory using single-stimulus response formats

Are the Signs of Factor Loadings Arbitrary in Confirmatory Factor Analysis? Problems and Solutions