Abstract:Sometimes, we do not use a maximum likelihood estimator of a probability but it's a smoothed estimator in order to cope with the zero frequency problem. This is often the case when we use the Naive Bayes classifier. Laplace smoothing is a popular choice with the value of Laplace smoothing estimator being the expected value of posterior distribution of the probability where we assume that the prior is uniform distribution. In this paper, we investigate the confidence intervals of the estimator of Laplace smoothing. We show that the likelihood function for this confidence interval is the same as the likelihood of a maximum likelihood estimated value of a probability of Bernoulli trials. Although the confidence interval of the maximum likelihood estimator of the Bernoulli trial probability has been studied well, and although the approximate formulas for the confidence interval are well known, we cannot use the interval of maximum likelihood estimator since the interval contains the value 0, which is not suitable for the Naive Bayes classifier. We are also interested in the accuracy of existing approximation methods since these approximation methods are frequently used but their accuracy is not well discussed. Thus, we obtain the confidence interval by numerically integrating the likelihood function. In this paper, we report the difference between the confidence interval that we computed and the confidence interval by approximate formulas. Finally, we include a URL, where all of the intervals that we computed are available.

Smoothed Empirical Likelihood Confidence Intervals for Quantiles

SMOOTHED EMPIRICAL LIKELIHOOD CONFIDENCE INTERVALS FOR QUANTILE IN THE PRESENCE OF AUXILIARY INFORMATION

Empirical likelihood method for intermediate quantiles

Smoothed Empirical Likelihood Inference for the Difference of Two Quantiles with Right Censoring

Smoothed Block Empirical Likelihood for Quantiles of Weakly Dependent Processes

Smoothed Jackknife Empirical Likelihood for the One-Sample Difference of Quantiles.

Empirical Likelihood Confidence Intervals for Local Linear Smoothers

Smoothed empirical likelihood confidence intervals for conditional quantiles under randomly left-truncated data

Smoothed Empirical Likelihood for Quantile Regression Models with Response Data Missing at Random

Better Nonparametric Confidence Intervals Via Robust Bias Correction for Quantile Regression

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

A Simple Estimator for Quantile Panel Data Models Using Smoothed Quantile Regressions

Empirical Likelihood Confidence Intervals for Nonparametric Density Estimation

Empirical Likelihood of Conditional Quantile Difference with Left-Truncated and Dependent Data

Confidence Intervals Based on Local Linear Smoother

On the accuracy of empirical likelihood confidence regions for linear regression model

Adjusted Empirical Likelihood with High-Order One-Sided Coverage Precision

Confidence Interval of Probability Estimator of Laplace Smoothing

Bias-corrected Smoothed Score Function for Single-Index Models

Empirical likelihood for quantile regression models with longitudinal data

Smoothed Empirical Likelihood Inference and Variable Selection for Quantile Regression with Nonignorable Missing Response