Abstract:This article reviews the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) in model selection and the appraisal of psychological theory. The focus is on latent variable models, given their growing use in theory testing and construction. Theoretical statistical results in regression are discussed, and more important issues are illustrated with novel simulations involving latent variable models including factor analysis, latent profile analysis, and factor mixture models. Asymptotically, the BIC is consistent, in that it will select the true model if, among other assumptions, the true model is among the candidate models considered. The AIC is not consistent under these circumstances. When the true model is not in the candidate model set the AIC is efficient, in that it will asymptotically choose whichever model minimizes the mean squared error of prediction/estimation. The BIC is not efficient under these circumstances. Unlike the BIC, the AIC also has a minimax property, in that it can minimize the maximum possible risk in finite sample sizes. In sum, the AIC and BIC have quite different properties that require different assumptions, and applied researchers and methodologists alike will benefit from improved understanding of the asymptotic and finite-sample behavior of these criteria. The ultimate decision to use the AIC or BIC depends on many factors, including the loss function employed, the study's methodological design, the substantive research question, and the notion of a true model and its applicability to the study at hand.

QBIC of SEM for diffusion processes from discrete observations

Quasi-Akaike information criterion of structural equation modeling with latent variables for diffusion processes

Structural equation modeling with latent variables for diffusion processes and its application to sparse estimation

Deviance Information Criterion for Latent Variable Models and Misspecified Models

Integrated Deviance Information Criterion for Latent Variable Models

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Model Selection Principles in Misspecified Models

Asymptotics of AIC, BIC, and RMSEA for Model Selection in Structural Equation Modeling

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

A Theoretical Investigation of Several Model Selection Criteria for Dimensionality Reduction

Model Selection for Explosive Models

On the Equivalence of Factorized Information Criterion Regularization and the Chinese Restaurant Process Prior

Deviance Information Criterion for Bayesian Model Selection: Justification and Variation

The Dantzig selector for diffusion processes with covariates

The Focused Information Criterion for Stochastic Model Selection Problems Using $M$-Estimators

Variational Bayes for Mixture of Gaussian Structural Equation Models

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

A simple application of FIC to model selection

Deviance Information Criterion for Model Selection : Justification and Variation ∗

Integrated deviance information criterion for spatial autoregressive models with heteroskedasticity

Kullback-Leibler Divergence and Akaike Information Criterion in General Hidden Markov Models