Abstract:Both frequentist and Bayesian statistics schools have improved statistical tools and model choices for the collected data or measurements. Model selection approaches have advanced due to the difficulty of comparing complicated hierarchical models in which linear predictors vary by grouping variables, and the number of model parameters is not distinct. Many regression model selection criteria are considered, including the maximum likelihood (ML) point estimation of the parameter and the logarithm of the likelihood of the dataset. This paper demonstrates the information complexity (ICOMP), Bayesian deviance information, or the widely applicable information criterion (WAIC) of the BRMS to hierarchical linear models fitted with repeated measures with a simulation and two real data examples. The Fisher information matrix for the Bayesian hierarchical model considering fixed and random parameters under maximizing a posterior estimation is derived. Using Gibbs sampling and Hybrid Hamiltonian Monte Carlo approaches, six different models were fitted for three distinct application datasets. The best-fitted candidate models were identified under each application dataset with the two MCMC approaches. In this case, the Bayesian hierarchical (mixed effect) linear model with random intercepts and random slopes estimated using the Hamiltonian Monte Carlo method best fits the two application datasets. Information complexity (ICOMP) is a better indicator of the best-fitted models than DIC and WAIC. In addition, the information complexity criterion showed that hierarchical models with gradient-based Hamiltonian Monte Carlo estimation are the best fit and have supper convergence relative to the gradient-free Gibbs sampling methods.

Information Geometry Approach to the Model Selection of Neural Networks

A New Geometric Approach to the Complexity of Model Selection

Invariance of reparametrization in model selection of neural networks

A New Model Selection Criterion Based on Information Geometry

A New Model Selection Criterion Based on Kullback-Leibler Information Divergence and Geometric Curvature

Information Geometric Model Selection Criterion and Its Application in Cognition

The Relation Between Intrinsic Complexity and Generalization of a Model and the Geometric Curvature

Information Geometry of Evolution of Neural Network Parameters While Training

Model Selection Criterion Applied To Visual Perception

Information Geometry on Pruning of Neural Network

Information Geometry on Modular and Hierarchical Neural Network

A Geometric Modeling of Occam's Razor in Deep Learning

Large-Scale Model Selection with Misspecification

Does the Geometry of the Data Control the Geometry of Neural Predictions? (Student Abstract)

Information Geometric Approach For Nonlinear Filtering

A Geometric Approach of Gradient Descent Algorithms in Linear Neural Networks

The Best Fit Bayesian Hierarchical Generalized Linear Model Selection Using Information Complexity Criteria in the MCMC Approach

Improved Neural Networks Based on Mutual Information Via Information Geometry.

Model Selection with Informative Normalized Maximum Likelihood: Data Prior and Model Prior

An Information Bottleneck Approach for Multi-View Feature Selection

Non-asymptotic model selection for linear non least-squares estimation in regression models and inverse problems