Abstract:Introduction: estimation of confidence intervals (CIs) of binomial proportions has been reviewed more than once but the directional interpretation, distinguishing the overestimation from the underestimation, was neglected while the sample size and theoretical proportion variances from experiment to experiment have not been formally taken in account. Herein, we define and apply new evaluation criteria, then give recommendations for the practical use of these CIs. Materials & methods: Google Scholar was used for bibliographic research. Evaluation criteria were (i) one-sided conditional errors, (ii) one-sided local average errors assuming a random theoretical proportion and (iii) expected half-widths of CIs. Results: Wald's CI did not control any of the risks, even when the expected number of successes reached 32. The likelihood ratio CI had a better balance than the logistic Wald CI. The Clopper-Pearson mid-P CI controlled well one-sided local average errors whereas the simple Clopper-Pearson CI was strictly conservative on both one-sided conditional errors. The percentile and basic bootstrap CIs had the same bias order as Wald's CI whereas the studentized CIs and BCa, modified for discrete bootstrap distributions, were less biased but not as efficient as the parametric methods. The half-widths of CIs mirrored local average errors. Conclusion: we recommend using the Clopper-Pearson mid-P CI for the estimation of a proportion except for observed-theoretical proportion comparison under controlled experimental conditions in which the Clopper-Pearson CI may be better.

Binomial Distribution: Hypothesis Testing, Confidence Intervals (CI), and Reliability with Implementation in S-PLUS

Proof of Han's Hypothesis on Relations among Two-Sided M-Bayesian Credible Limits and Corresponding Two-Sided Classical Confidence Limits

Computation of Reliability Statistics for Success-Failure Experiments

Binomial Distributed Data Confidence Interval Calculation: Formulas, Algorithms and Examples

On Finding the Upper Confidence Limit for a Binomial Proportion when Zero Successes are Observed

Two-sided confidence interval of a binomial proportion: how to choose?

Formulas, Algorithms and Examples for Binomial Distributed Data Confidence Interval Calculation: Excess Risk, Relative Risk and Odds Ratio

Sequential Tests of Statistical Hypotheses with Confidence Limits

Approaches to Achieving High Reliability and Confidence Levels with Small Test Sample Sizes

Confidence distributions and hypothesis testing

The Negative Binomial Process with Applications to Reliability

Generalised Clopper–Pearson confidence intervals for the binomial proportion

On randomized confidence intervals for the binomial probability

Valid and Approximately Valid Confidence Intervals for Current Status Data

Hypothesis Testing with Finite Statistics

Design and analysis of shortest two-sided confidence intervals for a probability under prior information

Computation of Reliability Statistics for Finite Samples of Success-Failure Experiments

An Entropy-Based Approach for Nonparametrically Testing Simple Probability Distribution Hypotheses

Exact Test of Goodness of Fit for Binomial Distribution

Interval estimation, point estimation, and null hypothesis significance testing calibrated by an estimated posterior probability of the null hypothesis

Binomial Confidence Intervals for Rare Events: Importance of Defining Margin of Error Relative to Magnitude of Proportion