Abstract:In the fields of education and psychology, nested data with small samples and imbalances are very common. Bauer et al. (2008) first proposed adjusting the traditional multilevel model to analyze the small sample imbalanced nested data (SSIND). In terms of parameter estimation, the Bayesian method shows the possibility of providing unbiased estimation when the sample size is small. This study proposes that the Bayesian method should be used to analyze the SSIND. This study explores the performance of different treatment effects and nesting effects estimation methods in the multilevel model based on the Bayesian method that performs well in the case of small samples, to provide an appropriate and scientific method reference for the subsequent analysis of the model. Two prior setting methods are compared for multilevel model effect estimation based on a small sample of imbalanced nested data in the Bayesian framework. Two prior setting methods are gamma prior setting method and uniform prior setting method. The research results show that when the treatment condition ICC is small (0.05), the bias and RMSE values of the parameter estimation by the gamma prior setting method are larger and the performance is unstable, while the bias and RMSE values of the parameter estimation by the uniform prior setting method are smaller and the performance is relatively stable, so the uniform prior setting method is recommended; when the treatment condition ICC is large (0.15), the bias and RMSE values of the parameter estimation by the uniform prior setting method are larger and the performance is unstable, while the bias and RMSE values of the parameter estimation by the gamma prior setting method are smaller and the performance is relatively stable, so the gamma prior setting method is recommended; when the treatment condition ICC is between 0.05 and 0.15, both prior setting methods have similar effects. Furthermore, when the number of treatment groups is small (8), the gamma prior setting method is recommended; when the number of treatment groups is large (16), the uniform prior setting method is recommended; when the number of treatment groups is between 8 and 16, both prior setting methods have similar effects. Summarily, when we choose which prior setting method to use for the SSIND, we must consider the interaction between the ICC and the number of treatment groups.

A Comparison of REML and Bayesian Estimation of Variance Components for Unbalanced One-way Random Effects Models With Small Sample Sizes

Comparison of Software Algorithms for Calculating Reml Wald Type Confidence Limits for the Between-Group Variance Component in A Small Sample One-Way Random Effects Model Example

Performance of Random Effects Model Estimators under Complex Sampling Designs

Closed-form REML estimators and sample size determination for mixed effects models for repeated measures under monotone missingness

Linear Mixed-Effects Models for Dependent Data: Power and Accuracy in Parameter Estimation.

THE EVALUATION OF BIAS OF THE WEIGHTED RANDOM EFFECTS MODEL ESTIMATORS

Misspecification Analysis of High-Dimensional Random Effects Models for Estimation of Signal-to-Noise Ratios

Comparison of REML and MCMC for Genetic Variance Component Model of Quantitative Trait in Nuclear Family

The Superiorities of Empirical Bayes Estimation of Variance Components in Random Effects Model

Comparison and robustness of the REML, ML, MIVQUE estimators for multi-level random mediation model

Bayesian Sample Size Computations inComplex Models with Application to RepeatedMeasures Random E ects Model Design

Model-based Bayesian inference under computer assisted balance-improving designs

Comparison of Prior Setting Methods for Multilevel Model Effect Estimation Based on Small Sample Imbalanced Nested Data in Bayesian Framework

Bayes Estimates of Variance Components in Mixed Linear Model

A comparison of recent approaches to the analysis of repeated measurements

Linear Approximate Bayes Estimator for Variance Components in Random Effects Model.

Evaluating two small-sample corrections for fixed-effects standard errors and inferences in multilevel models with heteroscedastic, unbalanced, clustered data

Differences of Type I error rates for ANOVA and Multilevel-Linear-Models using SAS and SPSS for repeated measures designs

Sample Size Estimation for Random-effects Models: Balancing Precision and Feasibility in Panel Studies

Restricted maximum likelihood estimation in generalized linear mixed models

A Quick and Accurate Method for the Estimation of Covariate Effects Based on Empirical Bayes Estimates in Mixed-Effects Modeling: Correction of Bias Due to Shrinkage.