Small Sample Interval Estimation of Non-normal Population

杭国明,祝国强

DOI: https://doi.org/10.3969/j.issn.1004-4337.2013.06.017

2013-01-01

Abstract:When the population is non-normal and the sample is a small one ,we can use such methods as exact probability calculation ,Fisher normal approximation and Chebyshev inequality to determine the confi-dence interval of unknow n parameters according to the difference conditions of the population .

What problem does this paper attempt to address?

Discretization Error of Irregular Sampling Approximations of Stochastic Integrals

Li-kai Zhou,Zhong-gen Su

DOI: https://doi.org/10.1007/s11766-016-3426-8

2016-01-01

Abstract:This paper studies the limit distributions for discretization error of irregular sampling approximations of stochastic integral. The irregular sampling approximation was first presented in Hayashi et al.[3], which was more general than the sampling approximation in Lindberg and Rootzén [10]. As applications, we derive the asymptotic distribution of hedging error and the Euler scheme of stochastic differential equation respectively.
Improved Estimation of Population Mean Through Known Conventional and Non-Conventional Measures of Auxiliary Variable

Muhammad Irfan,Maria Javed,Zhengyan Lin

DOI: https://doi.org/10.1007/s40995-018-0645-2

2018-01-01

Abstract:This paper proposes a generalized class of difference-cum-exponential-type estimators for population mean under simple random sampling without replacement through known conventional and non-conventional auxiliary information. It is observed that some well-known estimators are the members of our proposed class. Moreover, proposed class of estimators behaves efficiently than competing estimators under some simple conditions. Theoretical findings are confirmed with numerical illustration by using six real-life datasets. In addition, Monte Carlo simulation study on four real populations also approved the potential of the proposed class against competing estimators.
Confidence Interval Construction Based on the Adjusted-Range Self-Normalization Approach

Yongmiao Hong,Zhuo Lin,Jiajing Sun,Oliver B. Linton,Xiaolu Zhao

DOI: https://doi.org/10.2139/ssrn.4780667

2024-01-01

Abstract:This paper proposes a new self-normalization method to construct confidence intervals for quantities of stationary time series. Unlike the self-normalization approach in Shao (2010) and Lobato (2001), which utilize the variance of a partial as the self-normalizer, we propose the use of its adjusted range instead. Given range’s capacity to deal long-range dependence in highly non-Gaussian time series with large skewness and/or kurtosis (Mandelbrot and Wallis, 1969). This paper also introduces two range-based autocorrelation tests, extending Lobato (2001) and Shao (2010); and also a confidence interval construction for censored dependent data, extending Huang et al. (2015). The simulation studies confirm the validity of our approach.
A nonparametric Bayesian prediction interval for a finite population mean

Balgobin Nandram,Jiani Yin

DOI: https://doi.org/10.1080/00949655.2016.1151518

IF: 1.225

2016-02-18

Journal of Statistical Computation and Simulation

Abstract:Given a sample from a finite population, we provide a nonparametric Bayesian prediction interval for a finite population mean when a standard normal assumption may be tenuous. We will do so using a Dirichlet process (DP), a nonparametric Bayesian procedure which is currently receiving much attention. An asymptotic Bayesian prediction interval is well known but it does not incorporate all the features of the DP. We show how to compute the exact prediction interval under the full Bayesian DP model. However, under the DP, when the population size is much larger than the sample size, the computational task becomes expensive. Therefore, for simplicity one might still want to consider useful and accurate approximations to the prediction interval. For this purpose, we provide a Bayesian procedure which approximates the distribution using the exchangeability property (correlation) of the DP together with normality. We compare the exact interval and our approximate interval with three standard intervals, namely the design-based interval under simple random sampling, an empirical Bayes interval and a moment-based interval which uses the mean and variance under the DP. However, these latter three intervals do not fully utilize the posterior distribution of the finite population mean under the DP. Using several numerical examples and a simulation study we show that our approximate Bayesian interval is a good competitor to the exact Bayesian interval for different combinations of sample sizes and population sizes.

statistics & probability,computer science, interdisciplinary applications
Calculation of sample size guaranteeing the required width of the empirical confidence interval with predefined probability

Ilya Novikov

DOI: https://doi.org/10.48550/arXiv.1807.00365

2018-07-01

Methodology

Abstract:The goal of any estimation study is an interval estimation of a the parameter(s) of interest. These estimations are mostly expressed using empirical confidence intervals that are based on sample point estimates of the corresponding parameter(s). In contrast, calculations of the necessary sample size usually use expected confidence intervals that are based on the expected value of the parameter(s). The approach that guarantees the required probability of the required width of empirical confidence interval is known at least since 1989. However, till now, this approach is not implemented for most software and is not even described in many modern papers and textbooks. Here we present the concise description of the approach to sample size calculation for obtaining empirical confidence interval of the required width with the predefined probability and give a framework of its general implementation. We illustrate the approach in Normal, Poisson, and Binomial distributions. The numeric results showed that the sample size necessary to obtain the required width of empirical confidence interval with the standard probability of $0.8$ or $0.9$ may be more than 20\% larger than the sample size calculated for the expected values of the parameters.
Adjusted-Range Self-Normalized Confidence Interval Construction for Censored Dependent Data

Jiajing Sun,Yongmiao Hong,Oliver Linton,Xiaolu Zhao

DOI: https://doi.org/10.1016/j.econlet.2022.110873

IF: 1.469

2022-01-01

Economics Letters

Abstract:This paper proposes an adjusted-range based self-normalization (SN) method to construct confidence intervals for censored dependent data, which helps to circumvent the long-run variance estimation and tuning parameter selection problems. Simulation studies confirm the validity of this new approach.
Uncertainty Quantification and Confidence Intervals for Naive Rare-Event Estimators

Yuanlu Bai,Henry Lam

2024-04-26

Abstract:We consider the estimation of rare-event probabilities using sample proportions output by naive Monte Carlo or collected data. Unlike using variance reduction techniques, this naive estimator does not have a priori relative efficiency guarantee. On the other hand, due to the recent surge of sophisticated rare-event problems arising in safety evaluations of intelligent systems, efficiency-guaranteed variance reduction may face implementation challenges which, coupled with the availability of computation or data collection power, motivate the use of such a naive estimator. In this paper we study the uncertainty quantification, namely the construction, coverage validity and tightness of confidence intervals, for rare-event probabilities using only sample proportions. In addition to the known normality, Wilson's and exact intervals, we investigate and compare them with two new intervals derived from Chernoff's inequality and the Berry-Esseen theorem. Moreover, we generalize our results to the natural situation where sampling stops by reaching a target number of rare-event hits. Our findings show that the normality and Wilson's intervals are not always valid, but they are close to the newly developed valid intervals in terms of half-width. In contrast, the exact interval is conservative, but safely guarantees the attainment of the nominal confidence level. Our new intervals, while being more conservative than the exact interval, provide useful insights in understanding the tightness of the considered intervals.

Methodology,Statistics Theory
Sensitivity and specificity of normality tests and consequences on reference interval accuracy at small sample size: a computer-simulation study

Kevin Le Boedec

DOI: https://doi.org/10.1111/vcp.12390

Abstract:Background: According to international guidelines, parametric methods must be chosen for RI construction when the sample size is small and the distribution is Gaussian. However, normality tests may not be accurate at small sample size. Objectives: The purpose of the study was to evaluate normality test performance to properly identify samples extracted from a Gaussian population at small sample sizes, and assess the consequences on RI accuracy of applying parametric methods to samples that falsely identified the parent population as Gaussian. Methods: Samples of n = 60 and n = 30 values were randomly selected 100 times from simulated Gaussian, lognormal, and asymmetric populations of 10,000 values. The sensitivity and specificity of 4 normality tests were compared. Reference intervals were calculated using 6 different statistical methods from samples that falsely identified the parent population as Gaussian, and their accuracy was compared. Results: Shapiro-Wilk and D'Agostino-Pearson tests were the best performing normality tests. However, their specificity was poor at sample size n = 30 (specificity for P < .05: .51 and .50, respectively). The best significance levels identified when n = 30 were 0.19 for Shapiro-Wilk test and 0.18 for D'Agostino-Pearson test. Using parametric methods on samples extracted from a lognormal population but falsely identified as Gaussian led to clinically relevant inaccuracies. Conclusions: At small sample size, normality tests may lead to erroneous use of parametric methods to build RI. Using nonparametric methods (or alternatively Box-Cox transformation) on all samples regardless of their distribution or adjusting, the significance level of normality tests depending on sample size would limit the risk of constructing inaccurate RI.
On Estimation of Finite Population Proportion

Xinjia Chen

DOI: https://doi.org/10.48550/arXiv.0804.3779

2008-04-23

Statistics Theory

Abstract:In this paper, we study the classical problem of estimating the proportion of a finite population. First, we consider a fixed sample size method and derive an explicit sample size formula which ensures a mixed criterion of absolute and relative errors. Second, we consider an inverse sampling scheme such that the sampling is continue until the number of units having a certain attribute reaches a threshold value or the whole population is examined. We have established a simple method to determine the threshold so that a prescribed relative precision is guaranteed. Finally, we develop a multistage sampling scheme for constructing fixed-width confidence interval for the proportion of a finite population. Powerful computational techniques are introduced to make it possible that the fixed-width confidence interval ensures prescribed level of coverage probability.
On the Accuracy and Estimation Rate of Interval Estimation

杭国明,祝国强

DOI: https://doi.org/10.3969/j.issn.1004-4337.2014.01.018

2014-01-01

Abstract:In interval estimation ,the accuracy and estimation rate of interval estimation are contradicto-ry and both of them are related to the sample size .The present paper discusses how to improve the accuracy of interval estimation so as to attain the previous requirement w hen the estimation rate of interval estimation is certain for the given sample .
Two-Sample Inference in Highly Dispersed Negative Binomial Models

David Shilane,Derek Bean

DOI: https://doi.org/10.48550/arXiv.1203.0812

2012-03-05

Methodology

Abstract:Two-sample inference for the difference of population means typically relies upon a Central Limit Theorem approximation. When data are drawn from a Negative Binomial distribution, previous work of Shilane et al. (2010) showed that a Normal approximation is often unreliable in one-sample inference and proposed alternative techniques. We seek to extend these methods to the problem of two-sample inference on the difference of sample means in highly dispersed Negative Binomial models. We demonstrate that the Normal approximation is considerably more robust in the two-sample setting and may often be applied even when it is not appropriate for either sample individually. We also provide an intuitive extension of Bernstein's Inequality to the two-sample case. A simple mixture of these two methods may improve coverage in borderline and small sample settings. We subsequently investigate the coverage quality of confidence intervals and sample size considerations in a wide variety of simulation studies. Overall, we demonstrate that the Normal approximation is considerably more robust in approximating the distribution of the mean difference than the corresponding one-sample theory would suggest.
Normal approximation for nonlinear statistics using a concentration inequality approach

Louis H.Y. Chen,Qi-Man Shao

DOI: https://doi.org/10.3150/07-BEJ5164

2007-08-31

Abstract:Let $T$ be a general sampling statistic that can be written as a linear statistic plus an error term. Uniform and non-uniform Berry--Esseen type bounds for $T$ are obtained. The bounds are the best possible for many known statistics. Applications to U-statistics, multisample U-statistics, L-statistics, random sums and functions of nonlinear statistics are discussed.

Statistics Theory
Small Area Quantile Estimation

Jiahua Chen,Yukun Liu

DOI: https://doi.org/10.48550/arXiv.1705.10063

2017-05-29

Abstract:Sample surveys are widely used to obtain information about totals, means, medians, and other parameters of finite populations. In many applications, similar information is desired for subpopulations such as individuals in specific geographic areas and socio-demographic groups. When the surveys are conducted at national or similarly high levels, a probability sampling can result in just a few sampling units from many unplanned subpopulations at the design stage. Cost considerations may also lead to low sample sizes from individual small areas. Estimating the parameters of these subpopulations with satisfactory precision and evaluating their accuracy are serious challenges for statisticians. To overcome the difficulties, statisticians resort to pooling information across the small areas via suitable model assumptions, administrative archives, and census data. In this paper, we develop an array of small area quantile estimators. The novelty is the introduction of a semiparametric density ratio model for the error distribution in the unit-level nested error regression model. In contrast, the existing methods are usually most effective when the response values are jointly normal. We also propose a resampling procedure for estimating the mean square errors of these estimators. Simulation results indicate that the new methods have superior performance when the population distributions are skewed and remain competitive otherwise.

Methodology
On the Assessment of Bootstrap Intervals for Samples of Fixed Size

Weizhen Wang,Chongxiu Yu,Zhongzhan Zhang

2024-02-15

Abstract:A reasonable confidence interval should have a confidence coefficient no less than the given nominal level and a small expected length to reliably and accurately estimate the parameter of interest, and the bootstrap interval is considered to be an efficient interval estimation technique. In this paper, we offer a first attempt at computing the coverage probability and expected length of a parametric or percentile bootstrap interval by exact probabilistic calculation for any fixed sample size. This method is applied to the basic bootstrap intervals for functions of binomial proportions and a normal mean. None of these intervals, however, are found to have a correct confidence coefficient, which leads to illogical conclusions including that the bootstrap interval is narrower than the z-interval when estimating a normal mean. This raises a general question of how to utilize bootstrap intervals appropriately in practice since the sample size is typically fixed.

Statistics Theory,Computation
Repro Samples Method for Finite- and Large-Sample Inferences

Min-ge Xie,Peng Wang

DOI: https://doi.org/10.48550/arXiv.2206.06421

2022-06-13

Methodology

Abstract:This article presents a novel, general, and effective simulation-inspired approach, called {\it repro samples method}, to conduct statistical inference. The approach studies the performance of artificial samples, referred to as {\it repro samples}, obtained by mimicking the true observed sample to achieve uncertainty quantification and construct confidence sets for parameters of interest with guaranteed coverage rates. Both exact and asymptotic inferences are developed. An attractive feature of the general framework developed is that it does not rely on the large sample central limit theorem and is likelihood-free. As such, it is thus effective for complicated inference problems which we can not solve using the large sample central limit theorem. The proposed method is applicable to a wide range of problems, including many open questions where solutions were previously unavailable, for example, those involving discrete or non-numerical parameters. To reduce the large computational cost of such inference problems, we develop a unique matching scheme to obtain a data-driven candidate set. Moreover, we show the advantages of the proposed framework over the classical Neyman-Pearson framework. We demonstrate the effectiveness of the proposed approach on various models throughout the paper and provide a case study that addresses an open inference question on how to quantify the uncertainty for the unknown number of components in a normal mixture model. To evaluate the empirical performance of our repro samples method, we conduct simulations and study real data examples with comparisons to existing approaches. Although the development pertains to the settings where the large sample central limit theorem does not apply, it also has direct extensions to the cases where the central limit theorem does hold.
Guaranteed Conservative Fixed Width Confidence Intervals Via Monte Carlo Sampling

Fred J. Hickernell,Lan Jiang,Yuewei Liu,Art Owen

DOI: https://doi.org/10.48550/arXiv.1208.4318

2013-02-16

Abstract:Monte Carlo methods are used to approximate the means, $\mu$, of random variables $Y$, whose distributions are not known explicitly. The key idea is that the average of a random sample, $Y_1, ..., Y_n$, tends to $\mu$ as $n$ tends to infinity. This article explores how one can reliably construct a confidence interval for $\mu$ with a prescribed half-width (or error tolerance) $\varepsilon$. Our proposed two-stage algorithm assumes that the kurtosis of $Y$ does not exceed some user-specified bound. An initial independent and identically distributed (IID) sample is used to confidently estimate the variance of $Y$. A Berry-Esseen inequality then makes it possible to determine the size of the IID sample required to construct the desired confidence interval for $\mu$. We discuss the important case where $Y=f(\vX)$ and $\vX$ is a random $d$-vector with probability density function $\rho$. In this case $\mu$ can be interpreted as the integral $\int_{\reals^d} f(\vx) \rho(\vx) \dif \vx$, and the Monte Carlo method becomes a method for multidimensional cubature.

Statistics Theory,Numerical Analysis
Coverage Accuracy of Confidence Intervals in Nonparametric Regression

Song-xi Chen,Yong-song Qin

DOI: https://doi.org/10.1007/s10255-003-0113-3

2003-01-01

Abstract:Point-wise confidence intervals for a nonparametric regression function with random design pointsare considered. The confidence intervals are those based on the traditional normal approximation and theempirical likelihood. Their coverage accuracy is assessed by developing the Edgeworth expansions for thecoverage probabilities. It is shown that the empirical likelihood confidence intervals are Bartlett correctable.
Exact Confidence Intervals for Linear Combinations of Multinomial Probabilities

Katherine A. Batterton,Christine M. Schubert,Richard L. Warr

DOI: https://doi.org/10.48550/arXiv.2104.09474

2021-04-20

Abstract:Linear combinations of multinomial probabilities, such as those resulting from contingency tables, are of use when evaluating classification system performance. While large sample inference methods for these combinations exist, small sample methods exist only for regions on the multinomial parameter space instead of the linear combinations. However, in medical classification problems it is common to have small samples necessitating a small sample confidence interval on linear combinations of multinomial probabilities. Therefore, in this paper we derive an exact confidence interval, through the use of fiducial inference, for linear combinations of multinomial probabilities. Simulation demonstrates the presented interval's adherence to exact coverage. Additionally, an adjustment to the exact interval is provided, giving shorter lengths while still achieving better coverage than large sample methods. Computational efficiencies in estimation of the exact interval are achieved through the application of a fast Fourier transform and combining a numerical solver and stochastic optimizer to find solutions. The exact confidence interval presented in this paper allows for comparisons between diagnostic methods previously unavailable, demonstrated through an example of diagnosing chronic allograph nephropathy in post kidney transplant patients.

Methodology
Estimation and confidence sets for sparse normal mixtures

T. Tony Cai,Jiashun Jin,Mark G. Low

DOI: https://doi.org/10.1214/009053607000000334

2008-03-28

Abstract:For high dimensional statistical models, researchers have begun to focus on situations which can be described as having relatively few moderately large coefficients. Such situations lead to some very subtle statistical problems. In particular, Ingster and Donoho and Jin have considered a sparse normal means testing problem, in which they described the precise demarcation or detection boundary. Meinshausen and Rice have shown that it is even possible to estimate consistently the fraction of nonzero coordinates on a subset of the detectable region, but leave unanswered the question of exactly in which parts of the detectable region consistent estimation is possible. In the present paper we develop a new approach for estimating the fraction of nonzero means for problems where the nonzero means are moderately large. We show that the detection region described by Ingster and Donoho and Jin turns out to be the region where it is possible to consistently estimate the expected fraction of nonzero coordinates. This theory is developed further and minimax rates of convergence are derived. A procedure is constructed which attains the optimal rate of convergence in this setting. Furthermore, the procedure also provides an honest lower bound for confidence intervals while minimizing the expected length of such an interval. Simulations are used to enable comparison with the work of Meinshausen and Rice, where a procedure is given but where rates of convergence have not been discussed. Extensions to more general Gaussian mixture models are also given.

Statistics Theory
Comparison of recent estimators of uncertainty on the mean for small measurement samples with normal and non-normal error distributions

Pascal Pernot,Jean-Paul Berthet

DOI: https://doi.org/10.48550/arXiv.2209.04180

2022-09-09

Data Analysis, Statistics and Probability

Abstract:We review the alternative proposals introduced recently in the literature to update the standard formula to estimate the uncertainty on the mean of repeated measurements, and we compare their performances on synthetic examples with normal and non-normal error distributions.

Small Sample Interval Estimation of Non-normal Population

Discretization Error of Irregular Sampling Approximations of Stochastic Integrals

Improved Estimation of Population Mean Through Known Conventional and Non-Conventional Measures of Auxiliary Variable

Confidence Interval Construction Based on the Adjusted-Range Self-Normalization Approach

A nonparametric Bayesian prediction interval for a finite population mean

Calculation of sample size guaranteeing the required width of the empirical confidence interval with predefined probability

Adjusted-Range Self-Normalized Confidence Interval Construction for Censored Dependent Data

Uncertainty Quantification and Confidence Intervals for Naive Rare-Event Estimators

Sensitivity and specificity of normality tests and consequences on reference interval accuracy at small sample size: a computer-simulation study

On Estimation of Finite Population Proportion

On the Accuracy and Estimation Rate of Interval Estimation

Two-Sample Inference in Highly Dispersed Negative Binomial Models

Normal approximation for nonlinear statistics using a concentration inequality approach

Small Area Quantile Estimation

On the Assessment of Bootstrap Intervals for Samples of Fixed Size

Repro Samples Method for Finite- and Large-Sample Inferences

Guaranteed Conservative Fixed Width Confidence Intervals Via Monte Carlo Sampling

Coverage Accuracy of Confidence Intervals in Nonparametric Regression

Exact Confidence Intervals for Linear Combinations of Multinomial Probabilities

Estimation and confidence sets for sparse normal mixtures

Comparison of recent estimators of uncertainty on the mean for small measurement samples with normal and non-normal error distributions