Abstract:This article reviews the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) in model selection and the appraisal of psychological theory. The focus is on latent variable models, given their growing use in theory testing and construction. Theoretical statistical results in regression are discussed, and more important issues are illustrated with novel simulations involving latent variable models including factor analysis, latent profile analysis, and factor mixture models. Asymptotically, the BIC is consistent, in that it will select the true model if, among other assumptions, the true model is among the candidate models considered. The AIC is not consistent under these circumstances. When the true model is not in the candidate model set the AIC is efficient, in that it will asymptotically choose whichever model minimizes the mean squared error of prediction/estimation. The BIC is not efficient under these circumstances. Unlike the BIC, the AIC also has a minimax property, in that it can minimize the maximum possible risk in finite sample sizes. In sum, the AIC and BIC have quite different properties that require different assumptions, and applied researchers and methodologists alike will benefit from improved understanding of the asymptotic and finite-sample behavior of these criteria. The ultimate decision to use the AIC or BIC depends on many factors, including the loss function employed, the study's methodological design, the substantive research question, and the notion of a true model and its applicability to the study at hand.

Quasi-Akaike information criterion of structural equation modeling with latent variables for diffusion processes

QBIC of SEM for diffusion processes from discrete observations

Structural equation modeling with latent variables for diffusion processes and its application to sparse estimation

A Frequency Domain Criterion for Mimo Model Order/Structure Selection

Asymptotics of AIC, BIC, and RMSEA for Model Selection in Structural Equation Modeling

A Theoretical Investigation of Several Model Selection Criteria for Dimensionality Reduction

Information Criteria for Latent Factor Models: a Study on Factor Pervasiveness and Adaptivity.

Multilevel Latent Differential Structural Equation Model with Short Time Series and Time-Varying Covariates: A Comparison of Frequentist and Bayesian Estimators

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

The Focused Information Criterion for Stochastic Model Selection Problems Using $M$-Estimators

Latent Class Dynamic Mediation Model with Application to Smoking Cessation Data

Kullback-Leibler Divergence and Akaike Information Criterion in General Hidden Markov Models

A comparison of some criteria for states selection in the latent Markov model for longitudinal data

Theoretical Analysis and Comparison of Several Criteria on Linear Model Dimension Reduction

The Dantzig selector for diffusion processes with covariates

Scale-Invariance, Equivariance and Dependency of Structural Equation Models

Model Selection for Explosive Models

A Unified Approach to Focused Information Criterion and Plug-In Averaging Method

Variational Bayes for Mixture of Gaussian Structural Equation Models

A structural equation modeling approach for modeling variability as a latent variable.