Abstract:We consider the estimation of rare-event probabilities using sample proportions output by naive Monte Carlo or collected data. Unlike using variance reduction techniques, this naive estimator does not have a priori relative efficiency guarantee. On the other hand, due to the recent surge of sophisticated rare-event problems arising in safety evaluations of intelligent systems, efficiency-guaranteed variance reduction may face implementation challenges which, coupled with the availability of computation or data collection power, motivate the use of such a naive estimator. In this paper we study the uncertainty quantification, namely the construction, coverage validity and tightness of confidence intervals, for rare-event probabilities using only sample proportions. In addition to the known normality, Wilson's and exact intervals, we investigate and compare them with two new intervals derived from Chernoff's inequality and the Berry-Esseen theorem. Moreover, we generalize our results to the natural situation where sampling stops by reaching a target number of rare-event hits. Our findings show that the normality and Wilson's intervals are not always valid, but they are close to the newly developed valid intervals in terms of half-width. In contrast, the exact interval is conservative, but safely guarantees the attainment of the nominal confidence level. Our new intervals, while being more conservative than the exact interval, provide useful insights in understanding the tightness of the considered intervals.

Interval estimation under median ranked set sampling

The Linear Programming of Uncertain System with Interval Inequation Constraint Coefficients

On Median Control Charting Under Double Sampling Scheme

Small Sample Interval Estimation of Non-normal Population

Interval Estimation of Quantiles on Uniform Distribution

Maximum likelihood estimation of the parameters of the inverse Gaussian distribution using maximum rank set sampling with unequal samples

Inference for Median and a Generalization of HulC

Birnbaum-Saunders parameters estimation using simple random sampling and ranked set sampling

Uncertainty Quantification and Confidence Intervals for Naive Rare-Event Estimators

On the consistency of a spatial-type interval-valued median for random intervals

Ranking interval sets based on inclusion measures and applications to three-way decisions

On the Accuracy and Estimation Rate of Interval Estimation

Online stochastic Newton methods for estimating the geometric median and applications

Confidence Interval Construction Based on the Adjusted-Range Self-Normalization Approach

Improved modified estimator for estimation of median using auxiliary information under simple random sampling

A rank method for testing perfect ranking in multi-cycle ranked set sampling

Independent Range Sampling on Interval Data (Longer Version)

Small Area Quantile Estimation

On Estimation of Finite Population Proportion

Efficiently Simulating the Coverage Properties of Interval Estimates

Prediction of future observations based on ordered extreme k-records ranked set sampling with unequal fixed and random sample sizes