Use of spurious correlation for multiplicity adjustment

Yoshiyuki Ninomiya,Satoshi Kuriki,Toshihiko Shiroishi,Toyoyuki Takada
DOI: https://doi.org/10.48550/arXiv.1612.06029
2016-12-19
Methodology
Abstract:We consider one of the most basic multiple testing problems that compares expectations of multivariate data among several groups. As a test statistic, a conventional (approximate) $t$-statistic is considered, and we determine its rejection region using a common rejection limit. When there are unknown correlations among test statistics, the multiplicity adjusted $p$-values are dependent on the unknown correlations. They are usually replaced with their estimates that are always consistent under any hypothesis. In this paper, we propose the use of estimates, which are not necessarily consistent and are referred to as spurious correlations, in order to improve statistical power. Through simulation studies, we verify that the proposed method asymptotically controls the family-wise error rate and clearly provides higher statistical power than existing methods. In addition, the proposed and existing methods are applied to a real multiple testing problem that compares quantitative traits among groups of mice and the results are compared.
What problem does this paper attempt to address?