Abstract:Both frequentist and Bayesian statistics schools have improved statistical tools and model choices for the collected data or measurements. Model selection approaches have advanced due to the difficulty of comparing complicated hierarchical models in which linear predictors vary by grouping variables, and the number of model parameters is not distinct. Many regression model selection criteria are considered, including the maximum likelihood (ML) point estimation of the parameter and the logarithm of the likelihood of the dataset. This paper demonstrates the information complexity (ICOMP), Bayesian deviance information, or the widely applicable information criterion (WAIC) of the BRMS to hierarchical linear models fitted with repeated measures with a simulation and two real data examples. The Fisher information matrix for the Bayesian hierarchical model considering fixed and random parameters under maximizing a posterior estimation is derived. Using Gibbs sampling and Hybrid Hamiltonian Monte Carlo approaches, six different models were fitted for three distinct application datasets. The best-fitted candidate models were identified under each application dataset with the two MCMC approaches. In this case, the Bayesian hierarchical (mixed effect) linear model with random intercepts and random slopes estimated using the Hamiltonian Monte Carlo method best fits the two application datasets. Information complexity (ICOMP) is a better indicator of the best-fitted models than DIC and WAIC. In addition, the information complexity criterion showed that hierarchical models with gradient-based Hamiltonian Monte Carlo estimation are the best fit and have supper convergence relative to the gradient-free Gibbs sampling methods.

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

Efficient Model Selection for Mixtures of Probabilistic PCA Via Hierarchical BIC.

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Choosing the number of factors in factor analysis with incomplete data via a novel hierarchical Bayesian information criterion

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

Factorized Asymptotic Bayesian Hidden Markov Models

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Recursive Mixture Factor Analyzer for Monitoring Multimode Time-Variant Industrial Processes

Bayesian factor selection in a hybrid approach to confirmatory factor analysis

A simple application of FIC to model selection

The Effective Sample Size in Bayesian Information Criterion for Level-Specific Fixed and Random Effects Selection in a Two-Level Nested Model

On the Equivalence of Factorized Information Criterion Regularization and the Chinese Restaurant Process Prior

The Best Fit Bayesian Hierarchical Generalized Linear Model Selection Using Information Complexity Criteria in the MCMC Approach

A note on variational Bayesian factor analysis.

Bayesian Model Selection via Mean-Field Variational Approximation

Parsimonious Mixtures of Matrix Variate Bilinear Factor Analyzers

Choosing the Number of Topics in LDA Models -- A Monte Carlo Comparison of Selection Criteria

An Effective Model Selection Criterion for Mixtures of Gaussian Processes.