Abstract:We explore the minimax optimality of goodness-of-fit tests on general domains using the kernelized Stein discrepancy (KSD). The KSD framework offers a flexible approach for goodness-of-fit testing, avoiding strong distributional assumptions, accommodating diverse data structures beyond Euclidean spaces, and relying only on partial knowledge of the reference distribution, while maintaining computational efficiency. We establish a general framework and an operator-theoretic representation of the KSD, encompassing many existing KSD tests in the literature, which vary depending on the domain. We reveal the characteristics and limitations of KSD and demonstrate its non-optimality under a certain alternative space, defined over general domains when considering $\chi^2$-divergence as the separation metric. To address this issue of non-optimality, we propose a modified, minimax optimal test by incorporating a spectral regularizer, thereby overcoming the shortcomings of standard KSD tests. Our results are established under a weak moment condition on the Stein kernel, which relaxes the bounded kernel assumption required by prior work in the analysis of kernel-based hypothesis testing. Additionally, we introduce an adaptive test capable of achieving minimax optimality up to a logarithmic factor by adapting to unknown parameters. Through numerical experiments, we illustrate the superior performance of our proposed tests across various domains compared to their unregularized counterparts.

New normality test in high dimension with kernel methods

A Normality Test for High-dimensional Data Based on the Nearest Neighbor Approach

Universal Hypothesis Testing with Kernels: Asymptotically Optimal Tests for Goodness of Fit

A uniform kernel trick for high-dimensional two-sample problems

Minimax Optimal Goodness-of-Fit Testing with Kernel Stein Discrepancy

Kernel Two-Sample Tests in High Dimension: Interplay Between Moment Discrepancy and Dimension-and-Sample Orders

Spectral Regularized Kernel Goodness-of-Fit Tests

Two Sample Testing in High Dimension via Maximum Mean Discrepancy

Kernel Two-Sample Tests for Manifold Data

Testing Elliptical Models in High Dimensions

On the Decreasing Power of Kernel and Distance Based Nonparametric Hypothesis Tests in High Dimensions

Two-Sample Test for Sparse High Dimensional Multinomial Distributions

Generalized kernel two-sample tests

Testing for normality in any dimension based on a partial differential equation involving the moment generating function

Spectral Regularized Kernel Two-Sample Tests

Testing Goodness of Fit of Conditional Density Models with Kernels

A High-dimensional Convergence Theorem for U-statistics with Applications to Kernel-based Testing

A Neural Network-Based Approach to Normality Testing for Dependent Data

A New Statistic for Testing Covariance Equality in High-Dimensional Gaussian Low-Rank Models

Testing high-dimensional multinomials with applications to text analysis

A High-Dimensional Cramér–von Mises Test