Using a linear mixed-effect model framework to estimate multivariate generalizability theory parameters in R

Zhehan Jiang,Mark Raymond,Dexin Shi,Christine DiStefano
DOI: https://doi.org/10.3758/s13428-020-01399-z
IF: 5.953
2020-05-15
Behavior Research Methods
Abstract:Multivariate generalizability theory (mG-theory) is an important framework in many behavioral and educational studies, as it describes useful psychometric properties of multidimensional assessments. Nevertheless, the use of mG-theory estimation is limited due to the lack of available software for carrying out the necessary calculations: users rely heavily on independent software programs such as mGENOVA and the BUGS/JAGS suite of programs. Considering the prevalence of R software, this paper presents a solution using the <i>glmmTMB</i> package to accomplish the estimation task. Users adopting the proposed method may find it more convenient for conducting both applied investigation and simulation studies without the need to switch between different software programs.
psychology, experimental, mathematical
What problem does this paper attempt to address?
The paper attempts to address the issue of software limitations in the practical application of multivariate Generalizability Theory (mG-theory) parameter estimation. Specifically, the current software used for estimating mG-theory parameters (such as mGENOVA and BUGS/JAGS) has some limitations, including insufficient capability to handle unbalanced designs, sparse or missing data, and incompatibility with R software. Therefore, the paper proposes a method using the `glmmTMB` package in R software to estimate mG-theory parameters to overcome these limitations and enable users to conveniently conduct applied and simulation studies within the R environment without switching between different software. ### Main Issues: 1. **Software Limitations**: Existing mG-theory parameter estimation software (such as mGENOVA and BUGS/JAGS) has limitations in handling complex designs, especially in dealing with unbalanced designs, sparse or missing data. 2. **Software Compatibility**: Existing software is incompatible with the R environment, causing users to switch between different software, increasing operational complexity and inconvenience. 3. **Computational Efficiency**: Existing software has slow computational speed when handling large-scale datasets, affecting the efficiency and practicality of the research. ### Solution: The paper proposes using the `glmmTMB` package in R software to estimate mG-theory parameters. The `glmmTMB` package has the following advantages: 1. **Flexibility**: It allows flexible specification of different variance and covariance structures, adapting to various complex designs. 2. **Compatibility**: Fully compatible with the R environment, users can complete all data processing and analysis tasks within R without switching to other software. 3. **Handling Missing Values**: Even if there are missing values in the dataset, the `glmmTMB` package can still perform parameter estimation, although it may introduce some bias. Through this method, researchers can more conveniently conduct studies on multivariate Generalizability Theory, improving the efficiency and accuracy of the research.