Estimating the Variability of Estimated Variance Components for Generalizability Theory

黎光明,张敏强
DOI: https://doi.org/10.3724/sp.j.1041.2009.00889
2009-01-01
Acta Psychologica Sinica
Abstract:Estimating variability is an essential part of generalizability theory and is of central importance. The study adopted Monte Carlo data simulation technique to explore the effect of three data distribution on four method of estimating variance components for generalizability theory. Three data distribution were normal data distribution, dichotomous data distribution and polytomous data distribution. Four estimated methods were traditional method, bootstrap method, jackknife method and Markov Chain Monte Carlo method (MCMC). The results show that the performance of four methods is different for three data distribution. Traditional method is good for normal distribution data and polychromous distribution data. But it is not good and needs to be adjusted for dichotomous distribution data. Jackknife method accurately estimates variance components for three data distribution. As for estimating variance components, adjusted bootstrap method is better than unadjusted bootstrap methods. Compared with MCMC method with non-informative priors, MCMC method with informative priors is good for estimating variance components in generalizability theory. Data distribution has an effect on the method of estimating variance components for generalizability theory. Those methods, which can be applied for normal data distribution, could not be applied for other distribution data such as dichotomous data distribution and polytomous data distribution. Data distribution imposes restrictions on estimating variance components for these four methods. So different methods need be distinguished to use to do a good analysis of cross-distribution for estimating variance components in generalizability theory
What problem does this paper attempt to address?