Abstract:The standard paired-sample testing approach in the multidimensional setting applies multiple univariate tests on the individual features, followed by p-value adjustments. Such an approach suffers when the data carry numerous features. A number of studies have shown that classification accuracy can be seen as a proxy for two-sample testing. However, neither theoretical foundations nor practical recipes have been proposed so far on how this strategy could be extended to multidimensional paired-sample testing. In this work, we put forward the idea that scoring functions can be produced by the decision rules defined by the perpendicular bisecting hyperplanes of the line segments connecting each pair of instances. Then, the optimal scoring function can be obtained by the pseudomedian of those rules, which we estimate by extending naturally the Hodges-Lehmann estimator. We accordingly propose a framework of a two-step testing procedure. First, we estimate the bisecting hyperplanes for each pair of instances and an aggregated rule derived through the Hodges-Lehmann estimator. The paired samples are scored by this aggregated rule to produce a unidimensional representation. Second, we perform a Wilcoxon signed-rank test on the obtained representation. Our experiments indicate that our approach has substantial performance gains in testing accuracy compared to the traditional multivariate and multiple testing, while at the same time estimates each feature's contribution to the final result.

Testing marginal homogeneity in Hilbert spaces with applications to stock market returns

Testing Equality of Autocovariance Operators for Functional Time Series

A uniform kernel trick for high-dimensional two-sample problems

Generalized Spectral Tests for Multivariate Martingale Difference Hypotheses

A Bootstrap Hypothesis Test for High-Dimensional Mean Vectors

A Global Homogeneity Test for High-Dimensional Linear Regression

Generalized spectral testing for multivariate continuous-time models

Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models Via Nonparametric Regression

Kernel-based Tests for Joint Independence

Tests for group-specific heterogeneity in high-dimensional factor models

Simulation-Based Hypothesis Testing of High Dimensional Means Under Covariance Heterogeneity

Testing the homogeneity of risk differences with sparse count data

Testing Equality of Spectral Density Operators for Functional Processes

Testing distributional equality for functional random variables

Testing for homogeneity of several functional variables via multiple maximum variance discrepancy

Testing the goodness-of-fit of the stable distributions with applications to German stock index data and Bitcoin cryptocurrency data

Testing the equality of multivariate means when $p>n$ by combining the Hoteling and Simes tests

TESTING HOMOGENEITY IN PANEL DATA MODELS WITH INTERACTIVE FIXED EFFECTS

A framework for paired-sample hypothesis testing for high-dimensional data

Testing for Homogeneity with Kernel Fisher Discriminant Analysis

High-dimensional Two-Sample Mean Vectors Test and Support Recovery with Factor Adjustment.