Generalized score test of homogeneity for mixed effects models

Hongtu Zhu,Heping Zhang
DOI: https://doi.org/10.1214/009053606000000380
2006-08-01
Abstract:Many important problems in psychology and biomedical studies require testing for overdispersion, correlation and heterogeneity in mixed effects and latent variable models, and score tests are particularly useful for this purpose. But the existing testing procedures depend on restrictive assumptions. In this paper we propose a class of test statistics based on a general mixed effects model to test the homogeneity hypothesis that all of the variance components are zero. Under some mild conditions, not only do we derive asymptotic distributions of the test statistics, but also propose a resampling procedure for approximating their asymptotic distributions conditional on the observed data. To overcome the technical challenge, we establish an invariance principle for random quadratic forms indexed by a parameter. A simulation study is conducted to investigate the empirical performance of the test statistics. A real data set is analyzed to illustrate the application of our theoretical results.
Statistics Theory
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the problem of testing homogeneity in mixed - effect models and latent variable models. Specifically, it is to test whether all variance components are zero. Many important problems in psychological and biomedical research require testing over - dispersion, correlation and heterogeneity, and score tests are particularly useful for these problems. However, the existing testing procedures rely on restrictive assumptions. The paper proposes a class of test statistics based on the generalized mixed - effect model to test the homogeneity hypothesis, derives the asymptotic distributions of these test statistics under certain conditions, and proposes a resampling procedure to approximate their asymptotic distributions given the observed data. To overcome the technical challenges, the author establishes an invariance principle for random quadratic forms. ### Specific Problem Description 1. **Homogeneity Hypothesis Testing**: - The core problem that the paper focuses on is to test whether it is necessary to include random effects or latent variables in the mixed - effect model or the latent variable model. Specifically, the author proposes a generalized mixed - effect model to test the homogeneity hypothesis \( H_0: \Sigma_{i,i'}(\gamma) = 0 \) for all \( i, i' \) against the alternative hypothesis \( H_1: \Sigma_{i,i'}(\gamma) \neq 0 \) for some \( i, i' \). 2. **Limitations of Existing Methods**: - Existing methods rely on restrictive assumptions and cannot fully handle the general correlation structure of random effects (or latent variables). For example, some literatures only consider the case of scalar random effects and ignore the complex correlation structure in the multi - dimensional case. 3. **Proposed New Method**: - The author proposes a new class of score test statistics and establishes its asymptotic theory. By introducing a parameterization method, the homogeneity hypothesis is transformed into the problem of testing whether a certain parameter is zero. In addition, a resampling procedure is developed to approximate the asymptotic distribution of the test statistic. 4. **Application and Verification**: - The paper verifies the effectiveness and superiority of the proposed test statistics through simulation studies and actual data analysis. The results show that the new method has higher power in detecting heterogeneity, especially in the case of small sample sizes. ### Summary This paper aims to solve the problem of homogeneity hypothesis testing in mixed - effect models and latent variable models, proposes a new class of score test statistics, and establishes its asymptotic theory. By introducing the parameterization method and the resampling procedure, the limitations of existing methods are overcome and the power of the test is improved.