Power Comparison between High Dimensional t-Test, Sign, and Signed Rank Tests

Long Feng

DOI: https://doi.org/10.48550/arXiv.1812.10625

2018-12-27

Methodology

Abstract:In this paper, we propose a power comparison between high dimensional t-test, sign and signed rank test for the one sample mean test. We show that the high dimensional signed rank test is superior to a high dimensional t test, but inferior to a high dimensional sign test.

What problem does this paper attempt to address?

Tests for a Multiple-Sample Problem in High Dimensions

Yanfeng Shen,Zhengyan Lin

DOI: https://doi.org/10.1080/03610926.2012.661505

2013-01-01

Abstract:In this article, we consider the problem of testing the hypothesis on mean vectors in multiple-sample problem when the number of observations is smaller than the number of variables. First we propose an independence rule test (IRT) to deal with high-dimensional effects. The asymptotic distributions of IRT under the null hypothesis as well as under the alternative are established when both the dimension and the sample size go to infinity. Next, using the derived asymptotic power of IRT, we propose an adaptive independence rule test (AIRT) that is particularly designed for testing against sparse alternatives. Our AIRT is novel in that it can effectively pick out a few relevant features and reduce the effect of noise accumulation. Real data analysis and Monte Carlo simulations are used to illustrate our proposed methods.
Efficient three-stage $t$-tests

Jay Bartroff

DOI: https://doi.org/10.1214/074921706000000626

2006-11-22

Abstract:Three-stage $t$-tests of separated one-sided hypotheses are derived, extending Lorden's optimal three-stage tests for the one-dimensional exponential family by using Lai and Zhang's generalization of Schwarz's optimal fully-sequential tests to the multiparameter exponential family. The resulting three-stage $t$-tests are shown to be asymptotically optimal, achieving the same average sample size as optimal fully-sequential tests.

Statistics Theory
An Adaptive Test for the Mean Vector in Large-P-small-n Problems

Yanfeng Shen,Zhengyan Lin

DOI: https://doi.org/10.1016/j.csda.2015.03.004

IF: 2.035

2015-01-01

Computational Statistics & Data Analysis

Abstract:The problem of testing the mean vector in a high-dimensional setting is considered. Up to date, most high-dimensional tests for the mean vector only make use of the marginal information from the variables, and do not incorporate the correlation information into the test statistics. A new testing procedure is proposed, which makes use of the covariance information between the variables. The new approach is novel in that it can select important variables that contain evidence against the null hypothesis and reduce the impact of noise accumulation. Simulations and real data analysis demonstrate that the new test has higher power than some competing methods proposed in the literature.
Identity Tests for High Dimensional Data Using Rmt

Cheng Wang,Jing Yang,Baiqi Miao,Longbing Cao

DOI: https://doi.org/10.1016/j.jmva.2013.03.015

2013-01-01

Abstract:In this work, we redefined two important statistics, the CLRT test [Z. Bai, D. Jiang, J. Yao, S. Zheng, Corrections to LRT on large-dimensional covariance matrix by RMT, The Annals of Statistics 37 (6B) (2009) 3822–3840] and the LW test [O. Ledoit, M. Wolf, Some hypothesis tests for the covariance matrix when the dimension is large compared to the sample size, The Annals of Statistics (2002) 1081–1102] on identity tests for high dimensional data using random matrix theories. Compared with existing CLRT and LW tests, the new tests can accommodate data which has unknown means and non-Gaussian distributions. Simulations demonstrate that the new tests have good properties in terms of size and power. What is more, even for Gaussian data, our new tests perform favorably in comparison to existing tests. Finally, we find the CLRT is more sensitive to eigenvalues less than 1 while the LW test has more advantages in relation to detecting eigenvalues larger than 1.
Penalized Independence Rule for Testing High-Dimensional Hypotheses

Yanfeng Shen,Zhengyan Lin,Jun Zhu

DOI: https://doi.org/10.1080/03610926.2010.484160

2011-01-01

Abstract:We consider a challenging problem of testing any possible association between a response variable and a set of predictors, when the dimensionality of predictors is much greater than the number of observations. In the context of generalized linear models, a new approach is proposed for testing against high-dimensional alternatives. Our method uses soft-thresholding to suppress stochastic noise and applies the independence rule to borrow strength across the predictors. Moreover, the method can provide a ranked predictor list and automatically select "important" features to retain in the test statistic. We compare the performance of this method with some competing approaches via real data and simulation studies, demonstrating that our method maintains relatively higher power against a wide family of alternatives.
Finite sample t-tests for high-dimensional means

Jun Li

DOI: https://doi.org/10.1016/j.jmva.2023.105183

IF: 1.387

2023-07-01

Journal of Multivariate Analysis

Abstract:When sample sizes are small, it becomes challenging for an asymptotic test requiring diverging sample sizes to maintain an accurate Type I error rate. In this paper, we consider one-sample, two-sample and ANOVA tests for mean vectors when data are high-dimensional but sample sizes are very small. We establish asymptotic t -distributions of the proposed U -statistics, which only require data dimensionality to diverge but sample sizes to be fixed and no less than 3. The proposed tests maintain accurate Type I error rates for a wide range of sample sizes and data dimensionality. Moreover, the tests are nonparametric and can be applied to data which are normally distributed or heavy-tailed. Simulation studies confirm the theoretical results for the tests. We also apply the proposed tests to an fMRI dataset to demonstrate the practical implementation of the methods.

statistics & probability
A Note on High Dimensional Two Sample Mean Test

Long Feng,Fasheng Sun

DOI: https://doi.org/10.48550/arXiv.1502.05455

2015-02-19

Methodology

Abstract:In this paper, we propose a new scalar and shift transform invariant test statistic for the high-dimensional two-sample location test. The expectation of our test is exactly zero under the null hypothesis. And we allow the dimension could be arbitrary large. Theoretical results and simulation comparison show the good performance of our test.
An adaptable generalization of Hotelling's $T^2$ test in high dimension

Haoran Li,Alexander Aue,Debashis Paul,Jie Peng,Pei Wang

DOI: https://doi.org/10.48550/arXiv.1609.08725

2018-02-18

Abstract:We propose a two-sample test for detecting the difference between mean vectors in a high-dimensional regime based on a ridge-regularized Hotelling's $T^2$. To choose the regularization parameter, a method is derived that aims at maximizing power within a class of local alternatives. We also propose a composite test that combines the optimal tests corresponding to a specific collection of local alternatives. Weak convergence of the stochastic process corresponding to the ridge-regularized Hotelling's $T^2$ is established and used to derive the cut-off values of the proposed test. Large sample properties are verified for a class of sub-Gaussian distributions. Through an extensive simulation study, the composite test is shown to compare favorably against a host of existing two-sample test procedure in a wide range of settings. The performance of the proposed test procedure is illustrated through an application to a breast cancer data set where the goal is to detect the pathways with different DNA copy number alterations across breast cancer subtypes.

Methodology
Another Argument in Favour of Wilcoxon's Signed Rank Test

Jonathan Rosenblatt,Yoav Benjamini

DOI: https://doi.org/10.48550/arXiv.1311.5354

2013-11-21

Statistics Theory

Abstract:The Wilcoxon Signed Rank test is typically called upon when testing whether a symmetric distribution has a specified centre and the Gaussianity is in question. As with all insurance policies it comes with a cost, even if small, in terms of power versus a t-test, when the distribution is indeed Gaussian. In this note we further show that even when the distribution tested is Gaussian there need not be power loss at all, if the alternative is of a mixture type rather than a shift. The signed rank test may turn out to be more powerful than the t-test, and the supposedly conservative strategy, might actually be the more powerful one. Drug testing and functional magnetic imaging are two such scenarios. Wilcoxon' signed rank test will typically be called upon by a researcher when testing for the location of a single population, using a small sample and Gaussianity is dubious. As all insurance policies, it will come with a cost-- power. It is well known, that under a Gaussian setup, the signed rank test is less powerful than, say, a t-test. The works of Pitman and others have reassured us that this power loss is surprisingly small. In this note we argue that the power loss might actually be smaller than typically assumed. In particular, if the deviation from the null Gaussian distribution is of a mixture type and not a shift type, the signed rank test is no longer dominated by the t-test and can actually be more powerful.
Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Linxi Liu,Yang Meng,Xiaoru Wu,Zhiliang Ying,Tian Zheng

DOI: https://doi.org/10.1080/10618600.2022.2051530

2022-01-01

Journal of Computational and Graphical Statistics

Abstract:Motivated by applications in high-dimensional settings, we propose a novel approach for testing the equality of two or more populations by constructing a class of intensity centered score processes. The resulting tests are analogous in spirit to the well-known class of weighted log-rank statistics that are widely used in survival analysis. The test statistics are nonparametric, computationally simple, and applicable to high-dimensional data. We establish the usual large sample properties by showing that the underlying log-rank score process converges weakly to a Gaussian random field with zero mean under the null hypothesis and with a drift under the contiguous alternatives. For the Kolmogorov-Smirnov-type and the Cramervon Mises-type statistics, we also establish the consistency result for any fixed alternative. Cutoff points for the test statistics are obtained by permutations or a simulation-based resampling method. The new approach is applied to a study of brain activation measured by functional magnetic resonance imaging when performing two linguistic tasks and also to a prostate cancer DNA microarray dataset. Supplementary materials for this article are available online.
RANK-BASED INDICES FOR TESTING INDEPENDENCE BETWEEN TWO HIGH-DIMENSIONAL VECTORS

Yeqing Zhou,Kai Xu,Liping Zhu,Runze Li

DOI: https://doi.org/10.1214/23-aos2339

Abstract:To test independence between two high-dimensional random vectors, we propose three tests based on the rank-based indices derived from Hoeffding's D, Blum-Kiefer-Rosenblatt's R and Bergsma-Dassios-Yanagimoto's τ*. Under the null hypothesis of independence, we show that the distributions of the proposed test statistics converge to normal ones if the dimensions diverge arbitrarily with the sample size. We further derive an explicit rate of convergence. Thanks to the monotone transformation-invariant property, these distribution-free tests can be readily used to generally distributed random vectors including heavily tailed ones. We further study the local power of the proposed tests and compare their relative efficiencies with two classic distance covariance/correlation based tests in high dimensional settings. We establish explicit relationships between D,R,τ* and Pearson's correlation for bivariate normal random variables. The relationships serve as a basis for power comparison. Our theoretical results show that under a Gaussian equicorrelation alternative, (i) the proposed tests are superior to the two classic distance covariance/correlation based tests if the components of random vectors have very different scales; (ii) the asymptotic efficiency of the proposed tests based on D,τ* and R are sorted in a descending order.
Power Enhancement in High Dimensional Cross-Sectional Tests

Jianqing Fan,Yuan Liao,Jiawei Yao

DOI: https://doi.org/10.3982/ECTA12749

IF: 6.1

2015-07-01

Econometrica

Abstract:We propose a novel technique to boost the power of testing a high-dimensional vector H : θ = 0 against sparse alternatives where the null hypothesis is violated only by a couple of components. Existing tests based on quadratic forms such as the Wald statistic often suffer from low powers due to the accumulation of errors in estimating high-dimensional parameters. More powerful tests for sparse alternatives such as thresholding and extreme-value tests, on the other hand, require either stringent conditions or bootstrap to derive the null distribution and often suffer from size distortions due to the slow convergence. Based on a screening technique, we introduce a "power enhancement component", which is zero under the null hypothesis with high probability, but diverges quickly under sparse alternatives. The proposed test statistic combines the power enhancement component with an asymptotically pivotal statistic, and strengthens the power under sparse alternatives. The null distribution does not require stringent regularity conditions, and is completely determined by that of the pivotal statistic. As specific applications, the proposed methods are applied to testing the factor pricing models and validating the cross-sectional independence in panel data models.
Test for a Mean Vector with Fixed or Divergent Dimension

Liang Peng,Yongcheng Qi,Fang Wang

DOI: https://doi.org/10.48550/arXiv.1405.5020

2014-05-20

Methodology

Abstract:It has been a long history in testing whether a mean vector with a fixed dimension has a specified value. Some well-known tests include the Hotelling $T^2$-test and the empirical likelihood ratio test proposed by Owen [Biometrika 75 (1988) 237-249; Ann. Statist. 18 (1990) 90-120]. Recently, Hotelling $T^2$-test has been modified to work for a high-dimensional mean, and the empirical likelihood method for a mean has been shown to be valid when the dimension of the mean vector goes to infinity. However, the asymptotic distributions of these tests depend on whether the dimension of the mean vector is fixed or goes to infinity. In this paper, we propose to split the sample into two parts and then to apply the empirical likelihood method to two equations instead of d equations, where d is the dimension of the underlying random vector. The asymptotic distribution of the new test is independent of the dimension of the mean vector. A simulation study shows that the new test has a very stable size with respect to the dimension of the mean vector, and is much more powerful than the modified Hotelling $T^2$-test.
Rank Based Tests for High Dimensional White Noise

Dachuan Chen,Fengyi Song,Long Feng

2023-07-19

Abstract:The development of high-dimensional white noise test is important in both statistical theories and applications, where the dimension of the time series can be comparable to or exceed the length of the time series. This paper proposes several distribution-free tests using the rank based statistics for testing the high-dimensional white noise, which are robust to the heavy tails and do not quire the finite-order moment assumptions for the sample distributions. Three families of rank based tests are analyzed in this paper, including the simple linear rank statistics, non-degenerate U-statistics and degenerate U-statistics. The asymptotic null distributions and rate optimality are established for each family of these tests. Among these tests, the test based on degenerate U-statistics can also detect the non-linear and non-monotone relationships in the autocorrelations. Moreover, this is the first result on the asymptotic distributions of rank correlation statistics which allowing for the cross-sectional dependence in high dimensional data.

Statistics Theory,Methodology
An adaptive test of the independence of high-dimensional data based on Kendall rank correlation coefficient

Lijuan Han,Yun Ma,Junshan Xie

DOI: https://doi.org/10.1080/10485252.2024.2435852

2024-12-06

Journal of Nonparametric Statistics

Abstract:The paper considers the test on the components independence of high-dimensional continuous random vectors based on the Kendall rank correlation coefficient. Under the null hypothesis, it proves that the sum-of-powers type statistics constructed by the Kendall rank correlation coefficient are asymptotically normally distributed and independent when the sum of the orders is odd, and they are also independent with the extreme-value-type test statistics of the Kendall rank correlation coefficient. Based on the asymptotic independence property, it proposes an adaptive test procedure which combines p -values from the sum-of-powers-type test and extreme-value-type test. Some simulations reveal that the proposed test method can significantly enhance the statistical power of the test while keep the type I error well controlled, and it is powerful against a wide range of alternatives (including dense, sparse or moderately sparse signals). To illustrate the use of the proposed adaptive test method, two real data sets are also analysed.

statistics & probability
A PERMUTATION TEST FOR TWO-SAMPLE MEANS AND SIGNAL IDENTIFICATION OF HIGH-DIMENSIONAL DATA

Efang Kong,Lengyang Wang,Yingcun Xia,Jin Liu

DOI: https://doi.org/10.5705/ss.202019.0425

IF: 1.4

2022-01-01

Statistica Sinica

Abstract:Permutation tests are widely used in practice. However, these tests either need restrictive assumptions for validity, or are not applicable to high-dimensional data. This study considers permutation tests for high-dimensional mean comparisons. Here, in order to get around these restrictions, the test statistics are calculated based on pseudo samples generated using a "binning" procedure. The corresponding permutation tests are proved to be asymptotically consistent. We also consider a related problem for signal identification and establish the asymptotic properties of the tests. Simulation studies demonstrate the favorable performance of our methods compared with that of existing tests. Finally, the proposed method is applied to a genome-wide association study for seven complex human diseases to identify possible single nucleotide polymorphisms associated with the diseases.
Double Robust high dimensional alpha test for linear factor pricing model

Ping Zhao,Long Feng,Hongfei Wang,Zhaojun Wang

DOI: https://doi.org/10.48550/arXiv.2408.06612

2024-09-14

Abstract:In this paper, we investigate alpha testing for high-dimensional linear factor pricing models. We propose a spatial sign-based max-type test to handle sparse alternative cases. Additionally, we prove that this test is asymptotically independent of the spatial-sign-based sum-type test proposed by Liu et al. (2023). Based on this result, we introduce a Cauchy Combination test procedure that combines both the max-type and sum-type tests. Simulation studies and real data applications demonstrate that the new proposed test procedure is robust not only for heavy-tailed distributions but also for the sparsity of the alternative hypothesis.

Methodology
Randomized tests for high-dimensional regression: A more efficient and powerful solution

Yue Li,Ilmun Kim,Yuting Wei

DOI: https://doi.org/10.48550/arXiv.2010.01289

2020-10-03

Methodology

Abstract:We investigate the problem of testing the global null in the high-dimensional regression models when the feature dimension $p$ grows proportionally to the number of observations $n$. Despite a number of prior work studying this problem, whether there exists a test that is model-agnostic, efficient to compute and enjoys high power, still remains unsettled. In this paper, we answer this question in the affirmative by leveraging the random projection techniques, and propose a testing procedure that blends the classical $F$-test with a random projection step. When combined with a systematic choice of the projection dimension, the proposed procedure is proved to be minimax optimal and, meanwhile, reduces the computation and data storage requirements. We illustrate our results in various scenarios when the underlying feature matrix exhibits an intrinsic lower dimensional structure (such as approximate block structure or has exponential/polynomial eigen-decay), and it turns out that the proposed test achieves sharp adaptive rates. Our theoretical findings are further validated by comparisons to other state-of-the-art tests on the synthetic data.
A High Dimensional Two-Sample Test under a Low Dimensional Factor Structure

Yingying Ma,Wei Lan,Hansheng Wang

DOI: https://doi.org/10.1016/j.jmva.2015.05.005

IF: 1.387

2015-01-01

Journal of Multivariate Analysis

Abstract:Existing high dimensional two-sample tests usually assume that different elements of a high dimensional predictor are weakly dependent. Such a condition can be violated when data follow a low dimensional latent factor structure. As a result, the recently developed two-sample testing methods are not directly applicable. To fulfill such a theoretical gap, we propose here a Factor Adjusted two-Sample Testing (FAST) procedure to accommodate the low dimensional latent factor structure. Under the null hypothesis, together with fairly weak technical conditions, we show that the proposed test statistic is asymptotically distributed as a weighted chi-square distribution with a finite number of degrees of freedom. This leads to a totally different test statistic and inference procedure, as compared with those of Bai and Saranadasa (1996) and Chen and Qin (2010). Simulation studies are carried out to examine its finite sample performance. A real example on China stock market is analyzed for illustration purpose. (C) 2015 Elsevier Inc. All rights reserved.
A More Powerful Two-Sample Test in High Dimensions using Random Projection

Miles E. Lopes,Laurent J. Jacob,Martin J. Wainwright

DOI: https://doi.org/10.48550/arXiv.1108.2401

2011-08-11

Statistics Theory

Abstract:We consider the hypothesis testing problem of detecting a shift between the means of two multivariate normal distributions in the high-dimensional setting, allowing for the data dimension p to exceed the sample size n. Specifically, we propose a new test statistic for the two-sample test of means that integrates a random projection with the classical Hotelling T^2 statistic. Working under a high-dimensional framework with (p,n) tending to infinity, we first derive an asymptotic power function for our test, and then provide sufficient conditions for it to achieve greater power than other state-of-the-art tests. Using ROC curves generated from synthetic data, we demonstrate superior performance against competing tests in the parameter regimes anticipated by our theoretical results. Lastly, we illustrate an advantage of our procedure's false positive rate with comparisons on high-dimensional gene expression data involving the discrimination of different types of cancer.

Power Comparison between High Dimensional t-Test, Sign, and Signed Rank Tests

Tests for a Multiple-Sample Problem in High Dimensions

Efficient three-stage $t$-tests

An Adaptive Test for the Mean Vector in Large-P-small-n Problems

Identity Tests for High Dimensional Data Using Rmt

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Finite sample t-tests for high-dimensional means

A Note on High Dimensional Two Sample Mean Test

An adaptable generalization of Hotelling's $T^2$ test in high dimension

Another Argument in Favour of Wilcoxon's Signed Rank Test

Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

RANK-BASED INDICES FOR TESTING INDEPENDENCE BETWEEN TWO HIGH-DIMENSIONAL VECTORS

Power Enhancement in High Dimensional Cross-Sectional Tests

Test for a Mean Vector with Fixed or Divergent Dimension

Rank Based Tests for High Dimensional White Noise

An adaptive test of the independence of high-dimensional data based on Kendall rank correlation coefficient

A PERMUTATION TEST FOR TWO-SAMPLE MEANS AND SIGNAL IDENTIFICATION OF HIGH-DIMENSIONAL DATA

Double Robust high dimensional alpha test for linear factor pricing model

Randomized tests for high-dimensional regression: A more efficient and powerful solution

A High Dimensional Two-Sample Test under a Low Dimensional Factor Structure

A More Powerful Two-Sample Test in High Dimensions using Random Projection