Abstract:In this paper, we study some relationships between the detection and estimation theories for a binary composite hypothesis test ${\cal H}_{0}$ against ${\cal H}_{1}$ and a related estimation problem. We start with a one-dimensional (1D) space for the unknown parameter space and one-sided hypothesis problems and then extend out results into more general cases. For one-sided tests, we show that the uniformly most powerful (UMP) test is achieved by comparing the minimum variance and unbiased estimator (MVUE) of the unknown parameter with a threshold. Thus for the case where the UMP test does not exist, the MVUE of the unknown parameter does not exist either. Therefore for such cases, a good estimator of the unknown parameter is deemed as a good decision statistic for the test. For a more general class of composite testing with multiple unknown parameters, we prove that the MVUE of a separating function (SF) can serve as the optimal decision statistic for the UMP unbiased test where the SF is continuous, differentiable, positive for all parameters under ${\cal H}_{1}$ and is negative for the parameters under ${\cal H}_{0}$. We then prove that the UMP unbiased statistic is equal to the MVUE of an SF. In many problems with multiple unknown parameters, the UMP test does not exist. For such cases, we show that if one detector between two detectors has a better receiver operating characteristic (ROC) curve,11The detection probability versus the false alarm probability for a test. then using its decision statistic we can estimate the SF more $\epsilon$-accurately, in probability. For example, the SF is the signal-to-noise ratio (SNR) in some problems. These results motivate us to introduce new suboptimal SF-estimator tests (SFETs) which are easy to derive for many problems. Finally, we provide some practical examples to study the relationship between the decision statistic of a test and the estimator of its corresponding SF. The detection probability versus the false alarm probability for a test.

A five-decision testing procedure to infer on unidimensional parameter

A Unified Information Criterion For Evaluating Probe And Test Selection

Non-marginal Decisions: A Novel Bayesian Multiple Testing Procedure

Penalized Independence Rule for Testing High-Dimensional Hypotheses

M-Testing Using Finite and Infinite Dimensional Parameter Estimators

A Family of Bayes Multiple Testing Procedures

A Unified Framework for Testing High Dimensional Parameters: A Data-Adaptive Approach.

Exact Multivariate Tests - A New Effective Principle of Controlled Model Choice

A Unified Framework for Testing High Dimensional Parameters: A Data-Adaptive Approach

A New Multiple Testing Method in the Dependent Case

Simple solution to a common statistical problem: Interpreting multiple tests

Power-enhanced multiple decision functions controlling family-wise error and false discovery rates

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Separating Function Estimation Tests: A New Perspective on Binary Composite Hypothesis Testing

Are the tests overpowered or underpowered? A unified solution to correctly specify type I errors in design of clinical trials for two sample proportions

Optimal exact tests for multiple binary endpoints

Test of Significance for High-dimensional Thresholds with Application to Individualized Minimal Clinically Important Difference

Analysis of error control in large scale two-stage multiple hypothesis testing

The case for balanced hypothesis tests and equal-tailed confidence intervals

A Characterization of Most(More) Powerful Test Statistics with Simple Nonparametric Applications