Abstract:Both frequentist and Bayesian statistics schools have improved statistical tools and model choices for the collected data or measurements. Model selection approaches have advanced due to the difficulty of comparing complicated hierarchical models in which linear predictors vary by grouping variables, and the number of model parameters is not distinct. Many regression model selection criteria are considered, including the maximum likelihood (ML) point estimation of the parameter and the logarithm of the likelihood of the dataset. This paper demonstrates the information complexity (ICOMP), Bayesian deviance information, or the widely applicable information criterion (WAIC) of the BRMS to hierarchical linear models fitted with repeated measures with a simulation and two real data examples. The Fisher information matrix for the Bayesian hierarchical model considering fixed and random parameters under maximizing a posterior estimation is derived. Using Gibbs sampling and Hybrid Hamiltonian Monte Carlo approaches, six different models were fitted for three distinct application datasets. The best-fitted candidate models were identified under each application dataset with the two MCMC approaches. In this case, the Bayesian hierarchical (mixed effect) linear model with random intercepts and random slopes estimated using the Hamiltonian Monte Carlo method best fits the two application datasets. Information complexity (ICOMP) is a better indicator of the best-fitted models than DIC and WAIC. In addition, the information complexity criterion showed that hierarchical models with gradient-based Hamiltonian Monte Carlo estimation are the best fit and have supper convergence relative to the gradient-free Gibbs sampling methods.

Efficient Model Selection for Mixtures of Probabilistic PCA Via Hierarchical BIC.

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

A comparative study on selection of cluster number and local subspace dimension in the mixture PCA models

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Choosing the number of factors in factor analysis with incomplete data via a novel hierarchical Bayesian information criterion

An Effective Model Selection Criterion for Mixtures of Gaussian Processes.

Bayesian Inference on Principal Component Analysis Using Reversible Jump Markov Chain Monte Carlo.

A Dynamic Model Selection Algorithm for Mixtures of Gaussian Processes

Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach

Mixture Bayesian Regularization Method of PPCA for Multimode Process Monitoring

HeMPPCAT: Mixtures of Probabilistic Principal Component Analysers for Data with Heteroscedastic Noise

The Effective Sample Size in Bayesian Information Criterion for Level-Specific Fixed and Random Effects Selection in a Two-Level Nested Model

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Mixture Bayesian Regularization of PCR Model and Soft Sensing Application

Repulsive Mixture Models of Exponential Family PCA for Clustering

A Novelty Bayesian Method For Parameters Estimation And Model Selection

Bayesian Robust Principal Component Analysis with Adaptive Singular Value Penalty

The Best Fit Bayesian Hierarchical Generalized Linear Model Selection Using Information Complexity Criteria in the MCMC Approach

Large-Scale Model Selection with Misspecification

Comparison of WAIC and posterior predictive approaches for N-mixture models