Differential geometry of fibre bundles over foliated manifolds

G.Sardanashvily

DOI: https://doi.org/10.48550/arXiv.math-ph/0108020

2001-08-25

Abstract:Any leafwise connection on a fibre bundle over a foliated manifold is proved to come from a connection on this fibre bundle.

Mathematical Physics,Differential Geometry

What problem does this paper attempt to address?

Expected Coverage of Bayesian Confidence Intervals for the Mean of a Poisson Statistic in Measurements with Background

Ilya Narsky

DOI: https://doi.org/10.48550/arXiv.hep-ex/0005019

2000-05-11

High Energy Physics - Experiment

Abstract:Expected coverage and expected length of 90% upper and lower limit and 68.27% central intervals are plotted as functions of the true signal for various values of expected background. Results for several objective priors are shown, and formulas for calculation of confidence intervals are obtained. For comparison, expected coverage and length of frequentist intervals constructed with the unified approach of Feldman and Cousins and a simple classical method are also shown. It is assumed that the expected background is accurately known prior to performing an experiment. The plots of expected coverage and length are provided for values of signal and background typical for particle experiments with small numbers of events.
Empirical Likelihood Based Confidence Intervals For The Tail Index When Gamma <-1/2

Haoze Sun,Yuexiang Jiang

DOI: https://doi.org/10.1016/j.spl.2013.10.001

IF: 0.718

2014-01-01

Statistics & Probability Letters

Abstract:Empirical mortality data reveals that there is a finite age limit in the life span of humans, which means that it has a negative tail index. So far, there is a little literature on the confidence intervals for the tail index, especially for the negative tail index. In this paper, we construct its empirical likelihood based confidence intervals when γ<−1/2, which is known as the irregular case and derive the asymptotic χ2(1) distribution. At last a limited simulation study is conducted, which indicates that our method is better than the normal approximation in the sense of coverage probability and less sensitive to the selection of k.
Treatment of the background error in the statistical analysis of Poisson processes

C. Giunti

DOI: https://doi.org/10.1103/PhysRevD.59.113009

1999-05-06

Abstract:The formalism that allows to take into account the error sigma_b of the expected mean background b in the statistical analysis of a Poisson process with the frequentistic method is presented. It is shown that the error sigma_b cannot be neglected if it is not much smaller than sqrt(b). The resulting confidence belt is larger that the one for sigma_b=0, leading to larger confidence intervals for the mean mu of signal events.

High Energy Physics - Experiment,Data Analysis, Statistics and Probability
Confidence Intervals for Parameters of Unobserved Events

Amichai Painsky

DOI: https://doi.org/10.1080/01621459.2024.2314318

IF: 4.369

2024-03-20

Journal of the American Statistical Association

Abstract:Consider a finite sample from an unknown distribution over a countable alphabet. Unobserved events are alphabet symbols which do not appear in the sample. Estimating the probabilities of unobserved events is a basic problem in statistics and related fields, which was extensively studied in the context of point estimation. In this work we introduce a novel interval estimation scheme for unobserved events. Our proposed framework applies selective inference, as we construct confidence intervals (CIs) for the desired set of parameters. Interestingly, we show that obtained CIs are dimension-free, as they do not grow with the alphabet size. Further, we show that these CIs are (almost) tight, in the sense that they cannot be further improved without violating the prescribed coverage rate. We demonstrate the performance of our proposed scheme in synthetic and real-world experiments, showing a significant improvement over the alternatives. Finally, we apply our proposed scheme to large alphabet modeling. We introduce a novel simultaneous CI scheme for large alphabet distributions which outperforms currently known methods while maintaining the prescribed coverage rate. Supplementary materials for this article are available online including a standardized description of the materials available for reproducing the work.

statistics & probability
Parameter estimation for fractional Poisson processes

Dexter Cahoy,Vladimir V.Uchaikin,Wojbor A.Woyczynski

DOI: https://doi.org/10.48550/arXiv.1806.02774

2018-06-08

Abstract:The paper proposes a formal estimation procedure for parameters of the fractional Poisson process (fPp). Such procedures are needed to make the fPp model usable in applied situations. The basic idea of fPp, motivated by experimental data with long memory is to make the standard Poisson model more flexible by permitting non-exponential, heavy-tailed distributions of interarrival times and different scaling properties. We establish the asymptotic normality of our estimators for the two parameters appearing in our fPp model. This fact permits construction of the corresponding confidence intervals. The properties of the estimators are then tested using simulated data.

Methodology
Confidence Interval for Parameter of Exponential Distribution from Incomplete Observational Data

朱宏,肖百龙,徐道义

DOI: https://doi.org/10.3969/j.issn.1001-0548.2002.01.023

2002-01-01

Abstract:A question of formation confidence interval for parameter of exponential distribution from incomplete observational data is discussed. A new confidence interval method is given. The pivot variable for confidence interval estimation of the parameter is constructed by making use of any two order statistics. The distribution function and probability density function of this pivot variable is obtained. An approximate confidence interval from large sample is obtained also.
Generalised Clopper–Pearson confidence intervals for the binomial proportion

Borek Puza,Terence O'neill

DOI: https://doi.org/10.1080/10629360500107527

IF: 1.225

2006-06-01

Journal of Statistical Computation and Simulation

Abstract:In this paper we develop some new confidence intervals for the binomial proportion. The Clopper–Pearson interval is interpreted as an outcome of randomised confidence interval theory. The problem of randomised intervals possibly being empty is solved using a new technique involving ‘tail functions’, with the offshoot being a new class of randomised and Clopper–Pearson intervals. Some of the new intervals are investigated and shown to have attractive frequentist properties. Coverage probabilities and expected widths are compared and guidelines are established for constructing the optimal generalised Clopper–Pearson interval in any given situation.

statistics & probability,computer science, interdisciplinary applications
Monotonicity properties of the Poisson approximation to the binomial distribution

Iosif Pinelis

DOI: https://doi.org/10.1016/j.spl.2020.108901

2020-12-01

Abstract:<p>Certain monotonicity properties of the Poisson approximation to the binomial distribution are established. As a natural application of these results, exact (rather than approximate) tests of hypotheses on an unknown value of the parameter <span class="math"><math>p</math></span> of the binomial distribution are presented.</p>

statistics & probability
Confidence Regions for Parameters of Negative Binomial Distribution

Emmanuel Nkingi,Jan Vrbik

DOI: https://doi.org/10.48550/arXiv.1612.08113

2016-12-23

Statistics Theory

Abstract:We describe a general method for the construction of a confidence region for the two parameters of the Negative Binomial Distribution. This is achieved by expanding the sampling distribution of Method-of-Moments estimators, using the Central Limit Theorem.
An importance sampling method for Feldman-Cousins confidence intervals

Lukas Berns

DOI: https://doi.org/10.1103/PhysRevD.109.092002

2023-03-21

Abstract:In various high-energy physics contexts, such as neutrino-oscillation experiments, several assumptions underlying the typical asymptotic confidence interval construction are violated, such that one has to resort to computationally expensive methods like the Feldman-Cousins method for obtaining confidence intervals with proper statistical coverage. By construction, the computation of intervals at high confidence levels requires fitting millions or billions of pseudo-experiments, while wasting most of the computational cost on overly precise intervals at low confidence levels. In this work, a simple importance sampling method is introduced which reuses pseudo-experiments produced for all tested parameter values in a single mixture distribution. This results in a significant error reduction on the estimated critical values, especially at high confidence levels, and simultaneously yields a correct interpolation of these critical values between the parameter values at which the pseudo-experiments were produced. The theoretically calculated performance is demonstrated numerically using a simple example from the analysis of neutrino oscillations. The relationship to similar techniques applied in statistical mechanics and $p$-value computations is discussed.

High Energy Physics - Experiment,Data Analysis, Statistics and Probability
Bayesian Inference for the Gamma Zero-Truncated Poisson Distribution with an Application to Real Data

Patchanok Srisuradetchai,Ausaina Niyomdecha

DOI: https://doi.org/10.3390/sym16040417

2024-04-03

Symmetry

Abstract:This article presents Bayesian estimation methods applied to the gamma zero-truncated Poisson (GZTP) and the complementary gamma zero-truncated Poisson (CGZTP) distributions, encompassing both one-parameter and two-parameter models. These distributions are notably flexible and useful for modeling lifetime data. In the one-parameter model case, the Jeffreys prior is mathematically derived. The use of informative and noninformative priors, combined with the random walk Metropolis algorithm within a Bayesian framework, generates samples from the posterior distributions. Bayesian estimators' effectiveness is examined through extensive simulation studies, in comparison with the maximum likelihood method. Results indicate that Bayesian estimators provide more precise parameter estimates, even with smaller sample sizes. Furthermore, the study and comparison of the coverage probabilities (CPs) and average lengths (ALs) of the credible intervals with those from Wald intervals suggest that Bayesian credible intervals typically yield shorter ALs and higher CPs, thereby demonstrating the effectiveness of Bayesian inference in the context of GZTP and CGZTP distributions. Lastly, Bayesian inference is applied to real data.

multidisciplinary sciences
Calculation of sample size guaranteeing the required width of the empirical confidence interval with predefined probability

Ilya Novikov

DOI: https://doi.org/10.48550/arXiv.1807.00365

2018-07-01

Methodology

Abstract:The goal of any estimation study is an interval estimation of a the parameter(s) of interest. These estimations are mostly expressed using empirical confidence intervals that are based on sample point estimates of the corresponding parameter(s). In contrast, calculations of the necessary sample size usually use expected confidence intervals that are based on the expected value of the parameter(s). The approach that guarantees the required probability of the required width of empirical confidence interval is known at least since 1989. However, till now, this approach is not implemented for most software and is not even described in many modern papers and textbooks. Here we present the concise description of the approach to sample size calculation for obtaining empirical confidence interval of the required width with the predefined probability and give a framework of its general implementation. We illustrate the approach in Normal, Poisson, and Binomial distributions. The numeric results showed that the sample size necessary to obtain the required width of empirical confidence interval with the standard probability of $0.8$ or $0.9$ may be more than 20\% larger than the sample size calculated for the expected values of the parameters.
Confidence Intervals for Nonparametric Empirical Bayes Analysis

Nikolaos Ignatiadis,Stefan Wager

DOI: https://doi.org/10.48550/arXiv.1902.02774

2021-09-09

Abstract:In an empirical Bayes analysis, we use data from repeated sampling to imitate inferences made by an oracle Bayesian with extensive knowledge of the data-generating distribution. Existing results provide a comprehensive characterization of when and why empirical Bayes point estimates accurately recover oracle Bayes behavior. In this paper, we develop flexible and practical confidence intervals that provide asymptotic frequentist coverage of empirical Bayes estimands, such as the posterior mean or the local false sign rate. The coverage statements hold even when the estimands are only partially identified or when empirical Bayes point estimates converge very slowly.

Methodology
Importance sampling method for Feldman-Cousins confidence intervals

Lukas Berns

DOI: https://doi.org/10.1103/physrevd.109.092002

IF: 5.407

2024-05-09

Physical Review D

Abstract:In various high-energy physics contexts, such as neutrino-oscillation experiments, several assumptions underlying the typical asymptotic confidence interval construction are violated, such that one has to resort to computationally expensive methods like the Feldman-Cousins method for obtaining confidence intervals with proper statistical coverage. By construction, the computation of intervals at high confidence levels requires fitting millions or billions of pseudoexperiments, while wasting most of the computational cost on overly precise intervals at low confidence levels. In this work, a simple importance sampling method is introduced that reuses pseudoexperiments produced for all tested parameter values in a single mixture distribution. This results in a significant error reduction on the estimated critical values, especially at high confidence levels, and simultaneously yields a correct interpolation of these critical values between the parameter values at which the pseudoexperiments were produced. The theoretically calculated performance is demonstrated numerically using a simple example from the analysis of neutrino oscillations. The relationship to similar techniques applied in statistical mechanics and p -value computations is discussed. https://doi.org/10.1103/PhysRevD.109.092002 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Funded by SCOAP 3 . Published by the American Physical Society

astronomy & astrophysics,physics, particles & fields
Design and analysis of shortest two-sided confidence intervals for a probability under prior information

Rainer Göb,Kristina Lurz

DOI: https://doi.org/10.1007/s00184-013-0445-9

IF: 0.96

2013-06-01

Metrika

Abstract:Two-sided confidence intervals for a probability p$$p$$ under a prescribed confidence level γ$$\gamma $$ are an elementary tool of statistical data analysis. A confidence interval has two basic quality characteristics: i) exactness, i. e., whether the actual coverage probability equals or exceeds the prescribed level γ$$\gamma $$; ii) inferential precision, measured by the length of the confidence interval. The interval provided by Clopper and Pearson (Biometrika 26:404–413, 1934) is the only exact interval actually used in statistical data analysis. Various authors have suggested shorter, i. e., more precise exact intervals. The present paper makes two contributions. i) We provide a general design scheme for minimum volume confidence regions under prior knowledge on the target parameter. ii) We apply the scheme to the problem of confidence intervals for a probability p$$p$$ where prior knowledge is expressed in a flexible way by a beta distribution on a subset of the unit interval.

statistics & probability
On computing the distribution function for the Poisson binomial distribution

Yili Hong

DOI: https://doi.org/10.1016/j.csda.2012.10.006

2013-03-01

Abstract:The Poisson binomial distribution is the distribution of the sum of independent and non-identically distributed random indicators. Each indicator follows a Bernoulli distribution and the individual probabilities of success vary. When all success probabilities are equal, the Poisson binomial distribution is a binomial distribution. The Poisson binomial distribution has many applications in different areas such as reliability, actuarial science, survey sampling, econometrics, etc. The computing of the cumulative distribution function (cdf) of the Poisson binomial distribution, however, is not straightforward. Approximation methods such as the Poisson approximation and normal approximations have been used in literature. Recursive formulae also have been used to compute the cdf in some areas. In this paper, we present a simple derivation for an exact formula with a closed-form expression for the cdf of the Poisson binomial distribution. The derivation uses the discrete Fourier transform of the characteristic function of the distribution. We develop an algorithm that efficiently implements the exact formula. Numerical studies were conducted to study the accuracy of the developed algorithm and approximation methods. We also studied the computational efficiency of different methods. The paper is concluded with a discussion on the use of different methods in practice and some suggestions for practitioners.

statistics & probability,computer science, interdisciplinary applications
A Unified Approach to the Classical Statistical Analysis of Small Signals

Gary J. Feldman,Robert D. Cousins

DOI: https://doi.org/10.1103/PhysRevD.57.3873

1999-12-16

Abstract:We give a classical confidence belt construction which unifies the treatment of upper confidence limits for null results and two-sided confidence intervals for non-null results. The unified treatment solves a problem (apparently not previously recognized) that the choice of upper limit or two-sided intervals leads to intervals which are not confidence intervals if the choice is based on the data. We apply the construction to two related problems which have recently been a battle-ground between classical and Bayesian statistics: Poisson processes with background, and Gaussian errors with a bounded physical region. In contrast with the usual classical construction for upper limits, our construction avoids unphysical confidence intervals. In contrast with some popular Bayesian intervals, our intervals eliminate conservatism (frequentist coverage greater than the stated confidence) in the Gaussian case and reduce it to a level dictated by discreteness in the Poisson case. We generalize the method in order to apply it to analysis of experiments searching for neutrino oscillations. We show that this technique both gives correct coverage and is powerful, while other classical techniques that have been used by neutrino oscillation search experiments fail one or both of these criteria.

Data Analysis, Statistics and Probability,High Energy Physics - Experiment
Calculation of confidence intervals for simulation output

R. C. H. Cheng,W. Holland

DOI: https://doi.org/10.1145/1029174.1029176

IF: 0.851

2004-10-01

ACM Transactions on Modeling and Computer Simulation

Abstract:This article is concerned with the calculation of confidence intervals for simulation output that is dependent on two sources of variability. One, referred to as simulation variability , arises from the use of random numbers in the simulation itself; and the other, referred to as parameter variability , arises when the input parameters are unknown and have to be estimated from observed data. Three approaches to the calculation of confidence intervals are presented--the traditional asymptotic normality theory approach, a bootstrap approach and a new method which produces a conservative approximation based on performing just two simulation runs at carefully selected parameter settings. It is demonstrated that the traditional and bootstrap approaches provide similar degrees of accuracy and that whilst the new method may sometimes be very conservative, it can be calculated in a small fraction of the computational time of the exact methods.

computer science, interdisciplinary applications,mathematics, applied
Bayes inference for a non-homogeneous Poisson process with power intensity law (reliability)

M. Guida,R. Calabria,G. Pulcini

DOI: https://doi.org/10.1109/24.46489

IF: 5.883

1989-01-01

IEEE Transactions on Reliability

Abstract:Monte Carlo simulation is used to assess the statistical properties of some Bayes procedures in situations where only a few data on a system governed by a NHPP (nonhomogeneous Poisson process) can be collected and where there is little or imprecise prior information available. In particular, in the case of failure truncated data, two Bayes procedures are analyzed. The first uses a uniform prior PDF (probability distribution function) for the power law and a noninformative prior PDF for alpha , while the other uses a uniform PDF for the power law while assuming an informative PDF for the scale parameter obtained by using a gamma distribution for the prior knowledge of the mean number of failures in a given time interval. For both cases, point and interval estimation of the power law and point estimation of the scale parameter are discussed. Comparisons are given with the corresponding point and interval maximum-likelihood estimates for sample sizes of 5 and 10. The Bayes procedures are computationally much more onerous than the corresponding maximum-likelihood ones, since they in general require a numerical integration. In the case of small sample sizes, however, their use may be justified by the exceptionally favorable statistical properties shown when compared with the classical ones. In particular, their robustness with respect to a wrong assumption on the prior beta mean is interesting.<>

engineering, electrical & electronic,computer science, software engineering, hardware & architecture

Differential geometry of fibre bundles over foliated manifolds

Expected Coverage of Bayesian Confidence Intervals for the Mean of a Poisson Statistic in Measurements with Background

Empirical Likelihood Based Confidence Intervals For The Tail Index When Gamma <-1/2

Treatment of the background error in the statistical analysis of Poisson processes

Confidence Intervals for Parameters of Unobserved Events

Parameter estimation for fractional Poisson processes

Confidence Interval for Parameter of Exponential Distribution from Incomplete Observational Data

Generalised Clopper–Pearson confidence intervals for the binomial proportion

Monotonicity properties of the Poisson approximation to the binomial distribution

Confidence Regions for Parameters of Negative Binomial Distribution

An importance sampling method for Feldman-Cousins confidence intervals

Bayesian Inference for the Gamma Zero-Truncated Poisson Distribution with an Application to Real Data

Calculation of sample size guaranteeing the required width of the empirical confidence interval with predefined probability

Confidence Intervals for Nonparametric Empirical Bayes Analysis

Importance sampling method for Feldman-Cousins confidence intervals

Design and analysis of shortest two-sided confidence intervals for a probability under prior information

On computing the distribution function for the Poisson binomial distribution

A Unified Approach to the Classical Statistical Analysis of Small Signals

Calculation of confidence intervals for simulation output

Bayes inference for a non-homogeneous Poisson process with power intensity law (reliability)