Abstract:With uncorrelated Gaussian factors extended to mutually independent factors beyond Gaussian, the conventional factor analysis is extended to what is recently called independent factor analysis. Typically, it is called binary factor analysis (BFA) when the factors are binary and called non-Gaussian factor analysis (NFA) when the factors are from real non-Gaussian distributions. A crucial issue in both BFA and NFA is the determination of the number of factors. In the literature of statistics, there are a number of model selection criteria that can be used for this purpose. Also, the Bayesian Ying-Yang (BYY) harmony learning provides a new principle for this purpose. This paper further investigates BYY harmony learning in comparison with existing typical criteria, including Akaik’s information criterion (AIC), the consistent Akaike’s information criterion (CAIC), the Bayesian inference criterion (BIC), and the cross-validation (CV) criterion on selection of the number of factors. This comparative study is made via experiments on the data sets with different sample sizes, data space dimensions, noise variances, and hidden factors numbers. Experiments have shown that for both BFA and NFA, in most cases BIC outperforms AIC, CAIC, and CV while the BYY criterion is either comparable with or better than BIC. In consideration of the fact that the selection by these criteria has to be implemented at the second stage based on a set of candidate models which have to be obtained at the first stage of parameter learning, while BYY harmony learning can provide not only a new class of criteria implemented in a similar way but also a new family of algorithms that perform parameter learning at the first stage with automated model selection, BYY harmony learning is more preferred since computing costs can be saved significantly.

Bayesian factor selection in a hybrid approach to confirmatory factor analysis

Testing Informative Hypotheses in Factor Analysis Models Using Bayes Factors.

Exact Exploratory Bi-factor Analysis: A Constraint-based Optimisation Approach

Sparse Bayesian factor analysis when the number of factors is unknown

Bayesian Variable Selection Method Combining Generalized Linear Models with Factorial Effect Principles

Model-Selection-Based Approaches to Identifying the Optimal Number of Factors in Multilevel Exploratory Factor Analysis

Expandable Factor Analysis

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

A Comparison of Penalized Maximum Likelihood Estimation and Markov Chain Monte Carlo Techniques for Estimating Confirmatory Factor Analysis Models With Small Sample Sizes

Predictive Model Selection for Repeated Measures Random Effects Models Using Bayes Factors.

IDENTIFIABILITY OF BIFACTOR MODELS

Bayesian Analysis of Multi-Factorial Experimental Designs Using SEM

Bayesian factor models for multivariate categorical data obtained from questionnaires

A Comparative Investigation on Model Selection in Independent Factor Analysis

Bayesian Sensitivity Analysis of a Nonlinear Dynamic Factor Analysis Model with Nonparametric Prior and Possible Nonignorable Missingness

Bayesian latent factor regression for multivariate functional data with variable selection

Bayesian penalty methods for evaluating measurement invariance in moderated nonlinear factor analysis.

Bayesian Feature Extraction for Two-Part Latent Variable Model with Polytomous Manifestations

Bayesian Model Selection with Latent Group-Based Effects and Variances with the R Package slgf

A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality

Bayesian outcome selection modelling