Abstract:This article reviews the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) in model selection and the appraisal of psychological theory. The focus is on latent variable models, given their growing use in theory testing and construction. Theoretical statistical results in regression are discussed, and more important issues are illustrated with novel simulations involving latent variable models including factor analysis, latent profile analysis, and factor mixture models. Asymptotically, the BIC is consistent, in that it will select the true model if, among other assumptions, the true model is among the candidate models considered. The AIC is not consistent under these circumstances. When the true model is not in the candidate model set the AIC is efficient, in that it will asymptotically choose whichever model minimizes the mean squared error of prediction/estimation. The BIC is not efficient under these circumstances. Unlike the BIC, the AIC also has a minimax property, in that it can minimize the maximum possible risk in finite sample sizes. In sum, the AIC and BIC have quite different properties that require different assumptions, and applied researchers and methodologists alike will benefit from improved understanding of the asymptotic and finite-sample behavior of these criteria. The ultimate decision to use the AIC or BIC depends on many factors, including the loss function employed, the study's methodological design, the substantive research question, and the notion of a true model and its applicability to the study at hand.

On Bic'S Selection Consistency for Discriminant Analysis

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Main and Interaction Effects Selection for Quadratic Discriminant Analysis via Penalized Linear Regression

Automatic Coefficient Selection in Weighted Maximum Margin Criterion

Variable Selection with Stepwise and Best Subset Approaches.

Optimal Feature Selection in High-Dimensional Discriminant Analysis

Quadratic Discriminant Analysis by Projection

Efficient Model Selection for Mixtures of Probabilistic PCA Via Hierarchical BIC.

Variable Selection in Discriminant Partial Least-Squares Analysis

Choosing models in model-based clustering and discriminant analysis

Robust Bhattacharyya bound linear discriminant analysis through adaptive algorithm

Robust Variable and Interaction Selection for Logistic Regression and Multiple Index Models

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

A MODIFIED BIC TUNING PARAMETER SELECTOR FOR SICA-PENALIZED COX REGRESSION MODELS WITH DIVERGING DIMENSIONALITY

FEMDA: a unified framework for discriminant analysis

Discriminant functions arising from selection distributions: theory and simulation

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

Extending AIC to best subset regression

A High-dimensional M-estimator Framework for Bi-level Variable Selection

Consistent Model Selection Procedure for Random Coefficient INAR Models

Understanding Best Subset Selection: A Tale of Two C(omplex)ities