Multivariate Analysis of Microarray Data Using Hotelling's T 2 Test

Yan Lü,Peng‐Yuan Liu,Hong‐Wen Deng

DOI: https://doi.org/10.1002/9783527630332.ch6

2010-01-01

Abstract:This chapter contains sections titled: Introduction Methods Validation of Hotelling's T2 Statistic Application Examples Discussion References

What problem does this paper attempt to address?

Hotelling's T2 multivariate profiling for detecting differential expression in microarrays

LuYan,LiuPeng-Yuan,XiaoPeng,DengHong-Wen

IF: 5.8

2005-01-01

Bioinformatics

Abstract:Summary: The most widely used statistical methods for finding differentially expressed genes (DEGs) are essentially univariate. In this study, we present a new T 2 statistic for analyzing microarra...
An adaptable generalization of Hotelling's $T^2$ test in high dimension

Haoran Li,Alexander Aue,Debashis Paul,Jie Peng,Pei Wang

DOI: https://doi.org/10.48550/arXiv.1609.08725

2018-02-18

Abstract:We propose a two-sample test for detecting the difference between mean vectors in a high-dimensional regime based on a ridge-regularized Hotelling's $T^2$. To choose the regularization parameter, a method is derived that aims at maximizing power within a class of local alternatives. We also propose a composite test that combines the optimal tests corresponding to a specific collection of local alternatives. Weak convergence of the stochastic process corresponding to the ridge-regularized Hotelling's $T^2$ is established and used to derive the cut-off values of the proposed test. Large sample properties are verified for a class of sub-Gaussian distributions. Through an extensive simulation study, the composite test is shown to compare favorably against a host of existing two-sample test procedure in a wide range of settings. The performance of the proposed test procedure is illustrated through an application to a breast cancer data set where the goal is to detect the pathways with different DNA copy number alterations across breast cancer subtypes.

Methodology
Hotelling's test for highly correlated data

Peter Bubeliny

DOI: https://doi.org/10.48550/arXiv.1007.1094

2010-07-07

Abstract:This paper is motivated by the analysis of gene expression sets, especially by finding differentially expressed gene sets between two phenotypes. Gene $\log_2$ expression levels are highly correlated and, very likely, have approximately normal distribution. Therefore, it seems reasonable to use two-sample Hotelling's test for such data. We discover some unexpected properties of the test making it different from the majority of tests previously used for such data. It appears that the Hotelling's test does not always reach maximal power when all marginal distributions are differentially expressed. For highly correlated data its maximal power is attained when about a half of marginal distributions are essentially different. For the case when the correlation coefficient is greater than 0.5 this test is more powerful if only one marginal distribution is shifted, omparing to the case when all marginal distributions are equally shifted. Moreover, when the correlation coefficient increases the power of Hotelling's test increases as well.

Other Statistics
On the feasibility of parsimonious variable selection for Hotelling's $T^2$-test

Michael D. Perlman

DOI: https://doi.org/10.48550/arXiv.1910.03669

2019-10-08

Statistics Theory

Abstract:Hotelling's $T^2$-test for the mean of a multivariate normal distribution is one of the triumphs of classical multivariate analysis. It is uniformly most powerful among invariant tests, and admissible, proper Bayes, and locally and asymptotically minimax among all tests. Nonetheless, investigators often prefer non-invariant tests, especially those obtained by selecting only a small subset of variables from which the $T^2$-statistic is to be calculated, because such reduced statistics are more easily interpretable for their specific application. Thus it is relevant to ask the extent to which power is lost when variable selection is limited to very small subsets of variables, e.g. of size one (yielding univariate Student-$t^2$ tests) or size two (yielding bivariate $T^2$-tests). This study presents some evidence, admittedly fragmentary and incomplete, suggesting that in some cases no power may be lost over a wide range of alternatives.
A two-sample test for high-dimensional data with applications to gene-set testing

Song Xi Chen,Ying-Li Qin

DOI: https://doi.org/10.1214/09-aos716

2010-04-01

The Annals of Statistics

Abstract:We propose a two-sample test for the means of high-dimensional data when the data dimension is much larger than the sample size. Hotelling’s classical T2 test does not work for this “large p, small n” situation. The proposed test does not require explicit conditions in the relationship between the data dimension and sample size. This offers much flexibility in analyzing high-dimensional data. An application of the proposed test is in testing significance for sets of genes which we demonstrate in an empirical study on a leukemia data set.
Approaches and Practical Considerations for the Analysis of Toxicogenomics Data

Zhenqiang Su,Hong Fang,Weida Tong,Huixiao Hong,Roger Perkins,Lei Guo,Leming Shi

DOI: https://doi.org/10.1002/9781118001042.ch4

2011-01-01

Abstract:This chapter contains sections titled: Introduction Concerns on the Reproducibility of Microarray Data Many Different Ways for Identifying Differentially Expressed Genes (DEGs) Assessing the Performance of Gene Identification Methods A Toxicogenomics Case Study Drawback of p-Value Ranking in Analyzing Microarray Data Toward Consensus: Fold-Change Ranking with a Nonstringent p-Value Cutoff Conclusions References
A robust test approach for equality of mean vectors of two independent groups under the multivariate Behrens-Fisher problem

Hasan Bulut,Gülnur Karaosman

DOI: https://doi.org/10.1080/03610918.2024.2329237

2024-03-15

Communications in Statistics - Simulation and Computation

Abstract:In multivariate statistical inference, the Hotelling T2 statistic is used to test the equality of mean vectors for two independent groups. This statistic needs the multivariate normality and homogeneous covariance matrices assumptions. However, homogeneous covariance matrices assumption may not be provided in real applications. This case is called the multivariate Behrens-Fisher problem. There are several studies to test the equality of two mean vectors for the independent groups under the multivariate Behrens-fisher problem. But these studies do not interest in outliers at data sets. In this study, we propose solving problems caused by multivariate Behrens-Fisher and outliers in the dataset. We compare our proposed approach with other approaches regarding empirical size and power at simulated data that are both uncontaminated and contaminated. Thus we show that our proposed approach can be used to test the equality of mean vectors for two independent groups under multivariate Behrens-Fisher problem without being affected by outliers in the data. Moreover, we construct an R function in the MVTests package to use our proposed approach for real data applications.

statistics & probability
The Shrinkage Variance Hotelling $T^2$ Test for Genomic Profiling Studies

Grant Izmirlian

DOI: https://doi.org/10.48550/arXiv.1712.02845

2017-12-08

Abstract:Designed gene expression micro-array experiments, consisting of several treatment levels with a number of replicates per level, are analyzed by applying simple tests for group differences at the per gene level. The gene level statistics are sorted and a criterion for selecting important genes which takes into account multiplicity is applied. A caveat arises in that true signals (genes truly over or under expressed) are "competing" with fairly large type I error signals. False positives near the top of a sorted list can occur when genes having very small fold-change are compensated by small enough variance to yield a large test statistic. One of the first attempts around this caveat as the development of "significance analysis of micro-arrays (SAM)", which used a modified t-type statistic thresholded against its permutation distribution. The key innovation of the modified t-statistic was the addition of a constant to the per gene standard errors in order to stabilize the coefficient of variation of the resulting test statistic. Since then, several authors have proposed the use of shrinkage variance estimators in conjunction with t-type, and more generally, ANOVA type tests at the gene level. Our new approach proposes the use of a shrinkage variance Hotelling T-squared statistic in which the per gene sample covariance matrix is replaced by a shrinkage estimate borrowing strength from across all genes. It is demonstrated that the new statistic retains the F-distribution under the null, with added degrees of freedom in the denominator. Advantages of this class of tests are (i) flexibility in that a whole family of hypothesis tests is possible (ii) the gains of the above-mentioned earlier innovations are enjoyed more fully. This paper summarizes our results and presents a simulation study benchmarking the new statistic against another recently proposed statistic.

Methodology
A Neighborhood-Assisted Hotelling's $T^2$ Test for High-Dimensional Means

Jun Li,Yumou Qiu,Lingjun Li

DOI: https://doi.org/10.48550/arXiv.1712.01798

2017-12-05

Methodology

Abstract:Many tests have been proposed to remedy the classical Hotelling's $T^2$ test in the "large $p$, small $n$" paradigm, but the existence of an optimal sum-of-squares type test has not been explored. This paper shows that under certain conditions, the population Hotelling's $T^2$ test with the known $\Sigma^{-1}$ attains the best power among all the $L_2$-norm based tests with the data transformation by $\Sigma^{\eta}$ for $\eta \in (-\infty, \infty)$. To extend the result to the case of unknown $\Sigma^{-1}$, we propose a Neighborhood-Assisted Hotelling's $T^2$ statistic obtained by replacing the inverse of sample covariance matrix in the classical Hotelling's $T^2$ statistic with a regularized covariance estimator. Utilizing a regression model, we establish its asymptotic normality under mild conditions. We show that the proposed test is able to match the performance of the population Hotelling's $T^2$ test under certain conditions, and thus possesses certain optimality. Moreover, it can adaptively attain the best power by empirically choosing a neighborhood size to maximize its signal-to-noise ratio. Simulation experiments and case studies are given to demonstrate the empirical performance of the proposed test.
A Cramér Moderate Deviation Theorem for Hotelling’s $T^{2}$-Statistic with Applications to Global Tests

Weidong Liu,Qi-Man Shao

DOI: https://doi.org/10.1214/12-aos1082

2013-01-01

Abstract:A Cramer moderate deviation theorem for Hotelling's T-2-statistic is proved under a finite (3 + delta)th moment. The result is applied to large scale tests on the equality of mean vectors and is shown that the number of tests can be as large as e(0)(n(1/3)) before the chi-squared distribution calibration becomes inaccurate. As an application of the moderate deviation results, a global test on the equality of m mean vectors based on the maximum of Hotelling's T-2-statistics is developed and its asymptotic null distribution is shown to be an extreme value type I distribution. A novel intermediate approximation to the null distribution is proposed to improve the slow convergence rate of the extreme distribution approximation. Numerical studies show that the new test procedure works well even for a small sample size and performs favorably in analyzing a breast cancer dataset.
Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Yanfeng Shen,Zhengyan Lin,Jun Zhu

DOI: https://doi.org/10.1016/j.csda.2010.12.013

IF: 2.035

2011-01-01

Computational Statistics & Data Analysis

Abstract:Traditional multivariate tests such as Hotelling’s test or Wilk’s test are designed for classical problems, where the number of observations is much larger than the dimension of the variables. For high-dimensional data, however, this assumption cannot be met any longer. In this article, we consider testing problems in high-dimensional MANOVA where the number of variables exceeds the sample size. To overcome the challenges with high dimensionality, we propose a new approach called a shrinkage-based regularization test, which is suitable for a variety of data structures including the one-sample problem and one-way MANOVA. Our approach uses a ridge regularization to overcome the singularity of the sample covariance matrix and applies a soft-thresholding technique to reduce random noise and improve the testing power. An appealing property of this approach is its ability to select relevant variables that provide evidence against the hypothesis. We compare the performance of our approach with some competing approaches via real microarray data and simulation studies. The results illustrate that the proposed statistics maintains relatively high power in detecting a wide family of alternatives.
Central limit theorem for Hotelling's $T^2$ statistic under large dimension

G. M. Pan,W. Zhou

DOI: https://doi.org/10.48550/arXiv.0802.0082

2008-02-01

Probability

Abstract:In this paper we prove the central limit theorem for Hotelling's $T^2$ statistic when the dimension of the random vectors is proportional to the sample size.
A Cramér moderate deviation theorem for Hotelling's $T^2$-statistic with applications to global tests

Weidong Liu,Qi-Man Shao

DOI: https://doi.org/10.48550/arXiv.1304.2180

2013-04-08

Statistics Theory

Abstract:A Cramer moderate deviation theorem for Hotelling's $T^2$-statistic is proved under a finite $(3+\delta)$th moment. The result is applied to large scale tests on the equality of mean vectors and is shown that the number of tests can be as large as $e^{o(n^{1/3})}$ before the chi-squared distribution calibration becomes inaccurate. As an application of the moderate deviation results, a global test on the equality of m mean vectors based on the maximum of Hotelling's $T^2$-statistics is developed and its asymptotic null distribution is shown to be an extreme value type I distribution. A novel intermediate approximation to the null distribution is proposed to improve the slow convergence rate of the extreme distribution approximation. Numerical studies show that the new test procedure works well even for a small sample size and performs favorably in analyzing a breast cancer dataset.
A two-sample Bayesian t-test for microarray data

Richard J Fox,Matthew W Dimmic

DOI: https://doi.org/10.1186/1471-2105-7-126

IF: 3.307

2006-03-10

BMC Bioinformatics

Abstract:Abstract Background Determining whether a gene is differentially expressed in two different samples remains an important statistical problem. Prior work in this area has featured the use of t -tests with pooled estimates of the sample variance based on similarly expressed genes. These methods do not display consistent behavior across the entire range of pooling and can be biased when the prior hyperparameters are specified heuristically. Results A two-sample Bayesian t -test is proposed for use in determining whether a gene is differentially expressed in two different samples. The test method is an extension of earlier work that made use of point estimates for the variance. The method proposed here explicitly calculates in analytic form the marginal distribution for the difference in the mean expression of two samples, obviating the need for point estimates of the variance without recourse to posterior simulation. The prior distribution involves a single hyperparameter that can be calculated in a statistically rigorous manner, making clear the connection between the prior degrees of freedom and prior variance. Conclusion The test is easy to understand and implement and application to both real and simulated data shows that the method has equal or greater power compared to the previous method and demonstrates consistent Type I error rates. The test is generally applicable outside the microarray field to any situation where prior information about the variance is available and is not limited to cases where estimates of the variance are based on many similar observations.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Mean Test with Fewer Observation than Dimension and Ratio Unbiased Estimator for Correlation Matrix

Tiefeng Jiang,Ping Li

DOI: https://doi.org/10.48550/arXiv.2108.06892

2021-08-16

Statistics Theory

Abstract:Hotelling's T-squared test is a classical tool to test if the normal mean of a multivariate normal distribution is a specified one or the means of two multivariate normal means are equal. When the population dimension is higher than the sample size, the test is no longer applicable. Under this situation, in this paper we revisit the tests proposed by Srivastava and Du (2008), who revise the Hotelling's statistics by replacing Wishart matrices with their diagonal matrices. They show the revised statistics are asymptotically normal. We use the random matrix theory to examine their statistics again and find that their discovery is just part of the big picture. In fact, we prove that their statistics, decided by the Euclidean norm of the population correlation matrix, can go to normal, mixing chi-squared distributions and a convolution of both. Examples are provided to show the phase transition phenomenon between the normal and mixing chi-squared distributions. The second contribution of ours is a rigorous derivation of an asymptotic ratio-unbiased-estimator of the squared Euclidean norm of the correlation matrix.
Random fields of multivariate test statistics, with applications to shape analysis

J. E. Taylor,K. J. Worsley

DOI: https://doi.org/10.1214/009053607000000406

2008-03-12

Abstract:Our data are random fields of multivariate Gaussian observations, and we fit a multivariate linear model with common design matrix at each point. We are interested in detecting those points where some of the coefficients are nonzero using classical multivariate statistics evaluated at each point. The problem is to find the $P$-value of the maximum of such a random field of test statistics. We approximate this by the expected Euler characteristic of the excursion set. Our main result is a very simple method for calculating this, which not only gives us the previous result of Cao and Worsley [Ann. Statist. 27 (1999) 925--942] for Hotelling's $T^2$, but also random fields of Roy's maximum root, maximum canonical correlations [Ann. Appl. Probab. 9 (1999) 1021--1057], multilinear forms [Ann. Statist. 29 (2001) 328--371], $\bar{\chi}^2$ [Statist. Probab. Lett 32 (1997) 367--376, Ann. Statist. 25 (1997) 2368--2387] and $\chi^2$ scale space [Adv. in Appl. Probab. 33 (2001) 773--793]. The trick involves approaching the problem from the point of view of Roy's union-intersection principle. The results are applied to a problem in shape analysis where we look for brain damage due to nonmissile trauma.

Statistics Theory
Hotelling T2 control chart based on minimum vector variance for monitoring high‐dimensional correlated multivariate process

Odunayo Adiat Oyegoke,Kayode Samuel Adekeye,John Olutunji Olaomi,Jean‐Claude Malela‐Majika

DOI: https://doi.org/10.1002/qre.3687

2024-11-13

Quality and Reliability Engineering International

Abstract:Multivariate control charts are practical tools that simultaneously monitor several correlated quality characteristics in a process. Monitoring high‐dimensional data structures is challenging because, in most cases, the process sample size for monitoring parameters is greater than the number of process characteristics. Many researchers have used the multivariate Hotelling's T2 chart to monitor high‐dimensional data using the maximum‐likelihood methods (MLM) to estimate the covariance matrices. However, the multivariate Hotelling's T2chart based on MLM suffers from low statistical performance. In this paper, we proposed a multivariate Hotelling's T2 chart based on the minimum vector variance (MVV) and some regularized methods for monitoring high‐dimensional data structures. The performance of the proposed chart is evaluated in terms of the average run length (ARL). The results reveal the superiority of the proposed MVV Hotelling's T2 chart over the existing Hotelling's T2 charts for high‐dimensional correlated processes.

engineering, industrial, multidisciplinary,operations research & management science
A two-step strategy for detecting differential gene expression in cDNA microarray data

Yan Lu,Jun Zhu,Pengyuan Liu

DOI: https://doi.org/10.1007/s00294-004-0551-3

2004-01-01

Current Genetics

Abstract:A mixed-model approach is proposed for identifying differential gene expression in cDNA microarray experiments. This approach is implemented by two interconnected steps. In the first step, we choose a subset of genes that are potentially expressed differentially among treatments with a loose criterion. In the second step, these potential genes are used for further analyses and data-mining with a stringent criterion, in which differentially expressed genes (DEGs) are confirmed and some quantities of interest (such as gene × treatment interaction) are estimated. By simulating datasets with DEGs, we compare our statistical method with a widely used method, the t -statistic, for single genes. Simulation results show that our approach produces a high power and a low false discovery rate for DEG identification. We also investigate the impacts of various source variations resulting from microarray experiments on the efficiency of DEG identification. Analysis of a published experiment studying unstable transcripts in Arabidopsis illustrates the utility of our method. Our method identifies more novel and biologically interesting unstable transcripts than those reported in the original literature.
A comparative review of statistical methods for discovering differentially expressed genes in replicated microarray experiments

Wei Pan,W. Pan

DOI: https://doi.org/10.1093/bioinformatics/18.4.546

IF: 5.8

2002-04-01

Bioinformatics

Abstract:MOTIVATION: A common task in analyzing microarray data is to determine which genes are differentially expressed across two kinds of tissue samples or samples obtained under two experimental conditions. Recently several statistical methods have been proposed to accomplish this goal when there are replicated samples under each condition. However, it may not be clear how these methods compare with each other. Our main goal here is to compare three methods, the t-test, a regression modeling approach (Thomas et al., Genome Res., 11, 1227-1236, 2001) and a mixture model approach (Pan et al., http://www.biostat.umn.edu/cgi-bin/rrs?print+2001,2001a,b) with particular attention to their different modeling assumptions.RESULTS: It is pointed out that all the three methods are based on using the two-sample t-statistic or its minor variation, but they differ in how to associate a statistical significance level to the corresponding statistic, leading to possibly large difference in the resulting significance levels and the numbers of genes detected. In particular, we give an explicit formula for the test statistic used in the regression approach. Using the leukemia data of Golub et al. (Science, 285, 531-537, 1999), we illustrate these points. We also briefly compare the results with those of several other methods, including the empirical Bayesian method of Efron et al. (J. Am. Stat. Assoc., to appear, 2001) and the Significance Analysis of Microarray (SAM) method of Tusher et al. (PROC: Natl Acad. Sci. USA, 98, 5116-5121, 2001).

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
A one-sample location test based on weighted averaging of two test statistics in high-dimensional data

Masashi Hyodo,Takahiro Nishiyama

DOI: https://doi.org/10.48550/arXiv.1405.2370

2014-05-09

Statistics Theory

Abstract:We discuss a one-sample location test that can be used in the case of high-dimensional data. For high-dimensional data, the power of Hotelling's test decrises when the dimension is close to the sample size. To address this loss of power, some non-exact approaches were proposed, e.g., Dempster (1958, 1960), Bai and Saranadasa (1996) and Srivastava and Du (2006). In this paper, we focus on Hotelling's test and Dempster's test. The comparative merits and demerits of these two tests vary according to the local parameters. In particular, we consider the situation where it is difficult to determine which test should be used, that is, where the two tests are asymptotically equivalent in terms of local power. We propose a new statistic based on the weighted averaging of Hotelling's $T^2$ statistic and Dempster's statistic that can be applied in such a situation. Our weight is determined on the basis of the maximum local asymptotic power on a restricted parameter space that induces local asymptotic equivalence between Hotelling's test and Dempster's test. In addition, some good asymptotic properties with respect to the local power are shown. Numerical results show that our test is more stable than Hotelling's $T^2$ statistic and Dempster's statistic in most parameter settings.

Multivariate Analysis of Microarray Data Using Hotelling's T 2 Test

Hotelling's T2 multivariate profiling for detecting differential expression in microarrays

An adaptable generalization of Hotelling's $T^2$ test in high dimension

Hotelling's test for highly correlated data

On the feasibility of parsimonious variable selection for Hotelling's $T^2$-test

A two-sample test for high-dimensional data with applications to gene-set testing

Approaches and Practical Considerations for the Analysis of Toxicogenomics Data

A robust test approach for equality of mean vectors of two independent groups under the multivariate Behrens-Fisher problem

The Shrinkage Variance Hotelling $T^2$ Test for Genomic Profiling Studies

A Neighborhood-Assisted Hotelling's $T^2$ Test for High-Dimensional Means

A Cramér Moderate Deviation Theorem for Hotelling’s $T^{2}$-Statistic with Applications to Global Tests

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Central limit theorem for Hotelling's $T^2$ statistic under large dimension

A Cramér moderate deviation theorem for Hotelling's $T^2$-statistic with applications to global tests

A two-sample Bayesian t-test for microarray data

Mean Test with Fewer Observation than Dimension and Ratio Unbiased Estimator for Correlation Matrix

Random fields of multivariate test statistics, with applications to shape analysis

Hotelling T2 control chart based on minimum vector variance for monitoring high‐dimensional correlated multivariate process

A two-step strategy for detecting differential gene expression in cDNA microarray data

A comparative review of statistical methods for discovering differentially expressed genes in replicated microarray experiments

A one-sample location test based on weighted averaging of two test statistics in high-dimensional data