Abstract:For the universal hypothesis testing problem, where the goal is to decide between the known null hypothesis distribution and some other unknown distribution, Hoeffding proposed a universal test in the nineteen sixties. Hoeffding's universal test statistic can be written in terms of Kullback-Leibler (K-L) divergence between the empirical distribution of the observations and the null hypothesis distribution. In this paper a modification of Hoeffding's test is considered based on a relaxation of the K-L divergence test statistic, referred to as the mismatched divergence. The resulting mismatched test is shown to be a generalized likelihood-ratio test (GLRT) for the case where the alternate distribution lies in a parametric family of the distributions characterized by a finite dimensional parameter, i.e., it is a solution to the corresponding composite hypothesis testing problem. For certain choices of the alternate distribution, it is shown that both the Hoeffding test and the mismatched test have the same asymptotic performance in terms of error exponents. A consequence of this result is that the GLRT is optimal in differentiating a particular distribution from others in an exponential family. It is also shown that the mismatched test has a significant advantage over the Hoeffding test in terms of finite sample size performance. This advantage is due to the difference in the asymptotic variances of the two test statistics under the null hypothesis. In particular, the variance of the K-L divergence grows linearly with the alphabet size, making the test impractical for applications involving large alphabet distributions. The variance of the mismatched divergence on the other hand grows linearly with the dimension of the parameter space, and can hence be controlled through a prudent choice of the function class defining the mismatched divergence.

The exact null distribution of the generalized Hollander-Proschan type test for NBUE alternatives

Non-parametric Tests for the Tail Equivalence Via Empirical Likelihood

An Entropy-Based Approach for Nonparametrically Testing Simple Probability Distribution Hypotheses

A NEW TEST PROCEDURE FOR NEW BETTER THAN USED IN INCREASING CONVEX ORDERING

Inference on order restricted means of inverse Gaussian populations under heteroscedasticity

Testing distributional equality for functional random variables

Testing Homological Equivalence Using Betti Numbers

Asymptotics for non-degenerate multivariate $U$-statistics with estimated nuisance parameters under the null and local alternative hypotheses

Distribution-free Multiple Testing

Test For New Better Than Used In Convex Ordering

Universal and Composite Hypothesis Testing via Mismatched Divergence

Estimation of Proportion of Null Hypotheses Under Dependence

Asymptotic bayes optimality under sparsity for equicorrelated multivariate normal test statistics

Testing against ordered alternatives in one-way ANOVA model with exponential errors

Estimating the null distribution for conditional inference and genome-scale screening

Sequential Outlier Hypothesis Testing under Universality Constraints

Testing for normality in any dimension based on a partial differential equation involving the moment generating function

Goodness-of-fit test for count distributions with finite second moment

Asymptotic Bayes' optimality under sparsity for exchangeable dependent multivariate normal test statistics

Exact Bahadur Slope for combining independent tests in the case of the Pareto distribution

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model