Abstract:Under a multinormal distribution with an arbitrary unknown covariance matrix, the main purpose of this paper is to propose a framework to achieve the goal of reconciliation of Bayesian, frequentist, and Fisher's reporting $p$-values, Neyman-Pearson's optimal theory and Wald's decision theory for the problems of testing mean against restricted alternatives (closed convex cones). To proceed, the tests constructed via the likelihood ratio (LR) and the union-intersection (UI) principles are studied. For the problems of testing against restricted alternatives, first, we show that the LRT and the UIT are not the proper Bayes tests, however, they are shown to be the integrated LRT and the integrated UIT, respectively. For the problem of testing against the positive orthant space alternative, both the null distributions of the LRT and the UIT depend on the unknown nuisance covariance matrix. Hence we have difficulty adopting Fisher's approach to reporting $p$-values. On the other hand, according to the definition of the level of significance, both the LRT and the UIT are shown to be power-dominated by the corresponding LRT and UIT for testing against the half-space alternative, respectively. Hence, both the LRT and the UIT are $\alpha$-inadmissible, these results are against the common statistical sense. Neither Fisher's approach of reporting $p$-values alone nor Neyman-Pearson's optimal theory for power function alone is a satisfactory criterion for evaluating the performance of tests. Wald's decision theory via $d$-admissibility may shed light on resolving these challenging issues of imposing the balance between type 1 error and power.

Testing high-dimensional multinomials with applications to text analysis

Two-Sample Test for Sparse High Dimensional Multinomial Distributions

Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Testing Multivariate Uniformity and Its Applications

Distribution-Free Multisample Test Based on Optimal Matching with Applications to Single Cell Genomics

Joint Test for Homogeneity of High-Dimensional Means and Covariance Matrices Using Maximum-Type Statistics

A Robust and Nonparametric Two-Sample Test in High Dimensions

A Hyperbolic Divergence Based Nonparametric Test for Two‐sample Multivariate Distributions

Nonparametric Two-Sample Tests for Equality of Distributions Using Projections

Nonparametric High-Dimensional Multi-Sample Tests based on Graph Theory

Exact Multivariate Tests - A New Effective Principle of Controlled Model Choice

Minimax Nonparametric Two-sample Test under Smoothing

Multinomial Logistic Regression: Asymptotic Normality on Null Covariates in High-Dimensions

A High-Dimensional Cramér–von Mises Test

Two Sample Testing in High Dimension via Maximum Mean Discrepancy

Testing generalized linear models with high-dimensional nuisance parameter.

Testing multivariate normality by testing independence

Generalized kernel two-sample tests

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Testing Homogeneity in High Dimensional Data Through Random Projections

Equivalence Test in Multi-dimensional Space with Applications in A/B Testing