Abstract:We propose a framework for analyzing and comparing distributions without imposing any parametric assumptions via empirical likelihood methods. Our framework is used to study two fundamental statistical test problems: the two-sample test and the goodness-of-fit test. For the two-sample test, we need to determine whether two groups of samples are from different distributions; for the goodness-of-fit test, we examine how likely it is that a set of samples is generated from a known target distribution. Specifically, we propose empirical likelihood ratio (ELR) statistics for the two-sample test and the goodness-of-fit test, both of which are of linear time complexity and show higher power (i.e., the probability of correctly rejecting the null hypothesis) than the existing linear statistics for high-dimensional data. We prove the nonparametric Wilks' theorems for the ELR statistics, which illustrate that the limiting distributions of the proposed ELR statistics are chi-square distributions. With these limiting distributions, we can avoid bootstraps or simulations to determine the threshold for rejecting the null hypothesis, which makes the ELR statistics more efficient than the recently proposed linear statistic, finite set Stein discrepancy (FSSD). We also prove the consistency of the ELR statistics, which guarantees that the test power goes to 1 as the number of samples goes to infinity. In addition, we experimentally demonstrate and theoretically analyze that FSSD has poor performance or even fails to test for high-dimensional data. Finally, we conduct a series of experiments to evaluate the performance of our ELR statistics as compared to state-of-the-art linear statistics.

A Stein Goodness-of-fit Test for Directional Distributions

Interpretable Stein Goodness-of-fit Tests on Riemannian Manifolds

Standardisation-function Kernel Stein Discrepancy: A Unifying View on Kernel Stein Discrepancy Tests for Goodness-of-fit

Minimax Optimal Goodness-of-Fit Testing with Kernel Stein Discrepancy

A kernelized Stein discrepancy for goodness-of-fit tests

A Necessary Test of Goodness of Fit for Sphericity

Smoothing-based tests with directional random variables

Directional testing for one-way MANOVA in divergent dimensions

Testing Error Distribution by Kernelized Stein Discrepancy in Multivariate Time Series Models

Recent advances in directional statistics

A unified approach to goodness-of-fit testing for spherical and hyperspherical data

Least Favorable Direction Test for Multivariate Analysis of Variance in High Dimension

A Hyperbolic Divergence Based Nonparametric Test for Two‐sample Multivariate Distributions

A Stein Goodness of fit Test for Exponential Random Graph Models

A Test for Isotropy on a Sphere using Spherical Harmonic Functions

Nonparametric Measure-Transportation-Based Methods for Directional Data

Integral Transform Methods in Goodness-of-Fit Testing, II: The Wishart Distributions

A Fourier representation of kernel Stein discrepancy with application to Goodness-of-Fit tests for measures on infinite dimensional Hilbert spaces

Linear Kernel Tests Via Empirical Likelihood for High-Dimensional Data

Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Average Projection Type Weighted Cramér- Von Mises Statistics for Testing Some Distributions