Abstract:This article reviews the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) in model selection and the appraisal of psychological theory. The focus is on latent variable models, given their growing use in theory testing and construction. Theoretical statistical results in regression are discussed, and more important issues are illustrated with novel simulations involving latent variable models including factor analysis, latent profile analysis, and factor mixture models. Asymptotically, the BIC is consistent, in that it will select the true model if, among other assumptions, the true model is among the candidate models considered. The AIC is not consistent under these circumstances. When the true model is not in the candidate model set the AIC is efficient, in that it will asymptotically choose whichever model minimizes the mean squared error of prediction/estimation. The BIC is not efficient under these circumstances. Unlike the BIC, the AIC also has a minimax property, in that it can minimize the maximum possible risk in finite sample sizes. In sum, the AIC and BIC have quite different properties that require different assumptions, and applied researchers and methodologists alike will benefit from improved understanding of the asymptotic and finite-sample behavior of these criteria. The ultimate decision to use the AIC or BIC depends on many factors, including the loss function employed, the study's methodological design, the substantive research question, and the notion of a true model and its applicability to the study at hand.

Deviance Information Criterion for Bayesian Model Selection: Justification and Variation

Deviance Information Criterion for Model Selection : Justification and Variation ∗

Deviance Information Criterion for Latent Variable Models and Misspecified Models

Integrated Deviance Information Criterion for Latent Variable Models

Deviance Information Criterion for Comparing VAR Models

Posterior Averaging Information Criterion

Integrated deviance information criterion for spatial autoregressive models with heteroskedasticity

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

Variable Selection Using a Smooth Information Criterion for Distributional Regression Models

A Bayesian Information Criterion for Portfolio Selection

A simple application of FIC to model selection

Decision Curve Analysis: a Technical Note

Gibbs-Based Information Criteria and the Over-Parameterized Regime

Variational Discriminant Analysis with Variable Selection

Fit for a Bayesian: An Evaluation of PPP and DIC for Structural Equation Modeling

A Simple Information Criterion for Variable Selection in High‐Dimensional Regression

On the Equivalence of Factorized Information Criterion Regularization and the Chinese Restaurant Process Prior

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Model Selection Principles in Misspecified Models

A Theoretical Investigation of Several Model Selection Criteria for Dimensionality Reduction

PanIC: consistent information criteria for general model selection problems