Abstract:Designed gene expression micro-array experiments, consisting of several treatment levels with a number of replicates per level, are analyzed by applying simple tests for group differences at the per gene level. The gene level statistics are sorted and a criterion for selecting important genes which takes into account multiplicity is applied. A caveat arises in that true signals (genes truly over or under expressed) are "competing" with fairly large type I error signals. False positives near the top of a sorted list can occur when genes having very small fold-change are compensated by small enough variance to yield a large test statistic. One of the first attempts around this caveat as the development of "significance analysis of micro-arrays (SAM)", which used a modified t-type statistic thresholded against its permutation distribution. The key innovation of the modified t-statistic was the addition of a constant to the per gene standard errors in order to stabilize the coefficient of variation of the resulting test statistic. Since then, several authors have proposed the use of shrinkage variance estimators in conjunction with t-type, and more generally, ANOVA type tests at the gene level. Our new approach proposes the use of a shrinkage variance Hotelling T-squared statistic in which the per gene sample covariance matrix is replaced by a shrinkage estimate borrowing strength from across all genes. It is demonstrated that the new statistic retains the F-distribution under the null, with added degrees of freedom in the denominator. Advantages of this class of tests are (i) flexibility in that a whole family of hypothesis tests is possible (ii) the gains of the above-mentioned earlier innovations are enjoyed more fully. This paper summarizes our results and presents a simulation study benchmarking the new statistic against another recently proposed statistic.

An Improvement on the Hotelling $T^2$ Test Using the Ledoit-Wolf Nonlinear Shrinkage Estimator

A Neighborhood-Assisted Hotelling's $T^2$ Test for High-Dimensional Means

An adaptable generalization of Hotelling's $T^2$ test in high dimension

The Shrinkage Variance Hotelling $T^2$ Test for Genomic Profiling Studies

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

A Cramér moderate deviation theorem for Hotelling's $T^2$-statistic with applications to global tests

Mean Test with Fewer Observation than Dimension and Ratio Unbiased Estimator for Correlation Matrix

A More Powerful Two-Sample Test in High Dimensions using Random Projection

High-dimensional general linear hypothesis tests via non-linear spectral shrinkage

On the feasibility of parsimonious variable selection for Hotelling's $T^2$-test

Nonlinear shrinkage test on a large‐dimensional covariance matrix

A Non-Parametric Shrinkage Mean Estimation for Arbitrary Quadratic Loss Functions and Unknown Covariance Matrices

Two-sample testing in non-sparse high-dimensional linear models

Bayesian Optimal Two-sample Tests in High-dimension

Optimal Eigenvalue Shrinkage in the Semicircle Limit

Ledoit-Wolf linear shrinkage with unknown mean

A one-sample location test based on weighted averaging of two test statistics in high-dimensional data

Two-sample high dimensional mean test based on prepivots

Hotelling's test for highly correlated data

High-dimensional Two-Sample Mean Vectors Test and Support Recovery with Factor Adjustment.

Linear Hypothesis Testing in Linear Models With High-Dimensional Responses