Abstract:In this paper, we study some relationships between the detection and estimation theories for a binary composite hypothesis test ${\cal H}_{0}$ against ${\cal H}_{1}$ and a related estimation problem. We start with a one-dimensional (1D) space for the unknown parameter space and one-sided hypothesis problems and then extend out results into more general cases. For one-sided tests, we show that the uniformly most powerful (UMP) test is achieved by comparing the minimum variance and unbiased estimator (MVUE) of the unknown parameter with a threshold. Thus for the case where the UMP test does not exist, the MVUE of the unknown parameter does not exist either. Therefore for such cases, a good estimator of the unknown parameter is deemed as a good decision statistic for the test. For a more general class of composite testing with multiple unknown parameters, we prove that the MVUE of a separating function (SF) can serve as the optimal decision statistic for the UMP unbiased test where the SF is continuous, differentiable, positive for all parameters under ${\cal H}_{1}$ and is negative for the parameters under ${\cal H}_{0}$. We then prove that the UMP unbiased statistic is equal to the MVUE of an SF. In many problems with multiple unknown parameters, the UMP test does not exist. For such cases, we show that if one detector between two detectors has a better receiver operating characteristic (ROC) curve,11The detection probability versus the false alarm probability for a test. then using its decision statistic we can estimate the SF more $\epsilon$-accurately, in probability. For example, the SF is the signal-to-noise ratio (SNR) in some problems. These results motivate us to introduce new suboptimal SF-estimator tests (SFETs) which are easy to derive for many problems. Finally, we provide some practical examples to study the relationship between the decision statistic of a test and the estimator of its corresponding SF. The detection probability versus the false alarm probability for a test.

The case for balanced hypothesis tests and equal-tailed confidence intervals

Two-sided confidence interval of a binomial proportion: how to choose?

Confidence distributions and hypothesis testing

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Bi-linear Matrix-Variate Analyses, Integrative Hypothesis Tests, and Case-Control Studies

Changing the paradigm of fixed significance levels: Testing Hypothesis by Minimizing Sum of Errors Type I and Type II

Two-sided Confidence Bands with the Inferential Sensitivity of One-Sided Bands

Direction Preferring Confidence Intervals

One-tailed asymptotic inferences for the difference of proportions: Analysis of 97 methods of inference

Confidences in Hypotheses

A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions

On the Equivalence between Bayesian and Classical Hypothesis Testing

Optimal exact tests for multiple binary endpoints

An Objective and Robust Bayes Factor for the Hypothesis Test One Sample and Two Population Means

On the choice of the splitting ratio for the split likelihood ratio test

Separating Function Estimation Tests: A New Perspective on Binary Composite Hypothesis Testing

Intrinsic tests for the equality of two correlated proportions

Two New Methods for Non-Inferiority Testing of the Ratio in Matched-Pair Setting

A class of sequential multi-hypothesis tests

Are the tests overpowered or underpowered? A unified solution to correctly specify type I errors in design of clinical trials for two sample proportions