Abstract:The estimation of the correct number of dimensions is a long-standing problem in psychometrics. Several methods have been proposed, such as parallel analysis (PA), Kaiser-Guttman's eigenvalue-greaterthan-one rule, multiple average partial procedure (MAP), the maximum-likelihood approaches that use fit indexes as BIC and EBIC and the less used and studied approach called very simple structure (VSS). In the present paper a new approach to estimate the number of dimensions will be introduced and compared via simulation to the traditional techniques pointed above. The approach proposed in the current paper is called exploratory graph analysis (EGA), since it is based on the graphical lasso with the regularization parameter specified using EBIC. The number of dimensions is verified using the walktrap, a random walk algorithm used to identify communities in networks. In total, 32,000 data sets were simulated to fit known factor structures, with the data sets varying across different criteria: number of factors (2 and 4), number of items (5 and 10), sample size (100, 500, 1000 and 5000) and correlation between factors (orthogonal, .20, .50 and .70), resulting in 64 different conditions. For each condition, 500 data sets were simulated using lavaan. The result shows that the EGA performs comparable to parallel analysis, EBIC, eBIC and to KaiserGuttman rule in a number of situations, especially when the number of factors was two. However, EGA was the only technique able to correctly estimate the number of dimensions in the four-factor structure when the correlation between factors were .7, showing an accuracy of 100% for a sample size of 5,000 observations. Finally, the EGA was used to estimate the number of factors in a real dataset, in order to compare its performance with the other six techniques tested in the simulation study.

Determining the number of attributes in the GDINA model

Influence of Attributes Relationship to Parameter Estimation in DINA

An exploratory Q-matrix estimation method based on sparse non-negative matrix factorization

Cognitive Diagnostic Model Made More Practical by Genetic Algorithm.

Research on the Cognitive Diagnosis of Chinese Listening Comprehension Ability Based on the G-DINA Model

Exploratory graph analysis: a new approach for estimating the number of dimensions in psychological research

Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models

New development of cognitive diagnosis models

Explanatory Cognitive Diagnostic Models: Incorporating Latent and Observed Predictors

Modified Cognitive Diagnostic Index and Modified Attribute-Level Discrimination Index for Test Construction

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Determining the number of factors in a large-dimensional generalised factor model

One model to rule them all? Using machine learning algorithms to determine the number of factors in exploratory factor analysis.

A Graphical Diagnostic Classification Model

In Search of Optimal Cognitive Diagnostic Model(s) for ESL Grammar Test Data

Using country-specific Q-matrices for cognitive diagnostic assessments with international large-scale data

Sufficient and Necessary Conditions for the Identifiability of DINA Models with Polytomous Responses

Cognitive model construction and assessment of data analysis ability based on CDA

Dimensionality assessment in bifactor structures with multiple general factors: A network psychometrics approach.

Modeling question difficulty for unbiased cognitive diagnosis: A causal perspective

HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework