Empirical Bayes estimators for the reproduction parameter of Borel-Tanner distribution

George P. Yanev

DOI: https://doi.org/10.48550/arXiv.math/0602254

2006-02-13

Abstract:We construct empirical Bayes estimators for the reproduction parameter of Borel-Tanner distribution assuming LINEX loss and prove their asymptotic optimality. Some properties of the estimators regret risk are illustrated through simulations.

Statistics Theory

What problem does this paper attempt to address?

Empirical Bayes Estimators of Risk Premium under Variance Related Premium Principle

Yi ZHANG,Xiankun ZHANG,Limin WEN

DOI: https://doi.org/10.3969/j.issn.1001-4268.2018.04.002

2018-01-01

Abstract:Variance related premium principle is one of the most important principles not only in practice applications but also in research field of actuarial science.In this paper,the Bayesian models are established under variance related premium principle.The Bayesian estimate and credibility estimate of risk premium are derived.Furthermore,some statistical properties of estimators are discussed.In the models with multitude contract data,the unbiased consistent estimates of the structure parameters are proposed.Finally,the empirical Bayes estimator are proved to be asymptotically optimal.
A robust multivariate Birnbaum–Saunders distribution: EM estimation

Renata G. Romeiro,Filidor Vilca,N. Balakrishnan

DOI: https://doi.org/10.1080/02331888.2017.1398258

IF: 2.346

2017-12-05

Statistics

Abstract:We propose here a robust multivariate extension of the bivariate Birnbaum–Saunders (BS) distribution derived by Kundu et al. [Bivariate Birnbaum–Saunders distribution and associated inference. J Multivariate Anal. 2010;101:113–125], based on scale mixtures of normal (SMN) distributions that are used for modelling symmetric data. This resulting multivariate BS-type distribution is an absolutely continuous distribution whose marginal and conditional distributions are of BS-type distribution of Balakrishnan et al. [Estimation in the Birnbaum–Saunders distribution based on scalemixture of normals and the EM algorithm. Stat Oper Res Trans. 2009;33:171–192]. Due to the complexity of the likelihood function, parameter estimation by direct maximization is very difficult to achieve. For this reason, we exploit the nice hierarchical representation of the proposed distribution to propose a fast and accurate EM algorithm for computing the maximum likelihood (ML) estimates of the model parameters. We then evaluate the finite-sample performance of the developed EM algorithm and the asymptotic properties of the ML estimates through empirical experiments. Finally, we illustrate the obtained results with a real data and display the robustness feature of the estimation procedure developed here.

statistics & probability
Empirical Bayes When Estimation Precision Predicts Parameters

Jiafeng Chen

2024-04-09

Abstract:Empirical Bayes methods usually maintain a prior independence assumption: The unknown parameters of interest are independent from the known standard errors of the estimates. This assumption is often theoretically questionable and empirically rejected. This paper instead models the conditional distribution of the parameter given the standard errors as a flexibly parametrized family of distributions, leading to a family of methods that we call CLOSE. This paper establishes that (i) CLOSE is rate-optimal for squared error Bayes regret, (ii) squared error regret control is sufficient for an important class of economic decision problems, and (iii) CLOSE is worst-case robust when our assumption on the conditional distribution is misspecified. Empirically, using CLOSE leads to sizable gains for selecting high-mobility Census tracts. Census tracts selected by CLOSE are substantially more mobile on average than those selected by the standard shrinkage method.

Statistics Theory,Methodology
Empirical Bayes via ERM and Rademacher complexities: the Poisson model

Soham Jana,Yury Polyanskiy,Anzo Teh,Yihong Wu

2023-07-05

Abstract:We consider the problem of empirical Bayes estimation for (multivariate) Poisson means. Existing solutions that have been shown theoretically optimal for minimizing the regret (excess risk over the Bayesian oracle that knows the prior) have several shortcomings. For example, the classical Robbins estimator does not retain the monotonicity property of the Bayes estimator and performs poorly under moderate sample size. Estimators based on the minimum distance and non-parametric maximum likelihood (NPMLE) methods correct these issues, but are computationally expensive with complexity growing exponentially with dimension. Extending the approach of Barbehenn and Zhao (2022), in this work we construct monotone estimators based on empirical risk minimization (ERM) that retain similar theoretical guarantees and can be computed much more efficiently. Adapting the idea of offset Rademacher complexity Liang et al. (2015) to the non-standard loss and function class in empirical Bayes, we show that the shape-constrained ERM estimator attains the minimax regret within constant factors in one dimension and within logarithmic factors in multiple dimensions.

Statistics Theory
The empirical Bayes estimators of the rate parameter of the gamma distribution with a conjugate gamma prior under Stein's loss function

Ya-Guang Shi,Ying-Ying Zhang,Zheng Li

DOI: https://doi.org/10.1080/03610918.2024.2369811

2024-06-24

Communications in Statistics - Simulation and Computation

Abstract:For the hierarchical gamma and gamma model, we calculate the Bayes estimator of the rate parameter of the gamma distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes estimator of the rate parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the rate parameter of the gamma distribution with a conjugate gamma prior by the moment and MLE methods. In numerical simulations, we have illustrated five aspects: the two inequalities of the Bayes estimators and the PESLs for the oracle method; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data; the comparisons of the Bayes estimators and the PESLs of the oracle, moment, and MLE methods; and the marginal densities of the model for various hyperparameters. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, the model could potentially be used to fit right-skewed data, not left-skewed data.

statistics & probability
A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family

Trambak Banerjee,Qiang Liu,Gourab Mukherjee,Wenguang Sun

DOI: https://doi.org/10.48550/arXiv.1910.08997

2019-10-20

Abstract:We develop a Nonparametric Empirical Bayes (NEB) framework for compound estimation in the discrete linear exponential family, which includes a wide class of discrete distributions frequently arising from modern big data applications. We propose to directly estimate the Bayes shrinkage factor in the generalized Robbins' formula via solving a scalable convex program, which is carefully developed based on a RKHS representation of the Stein's discrepancy measure. The new NEB estimation framework is flexible for incorporating various structural constraints into the data driven rule, and provides a unified approach to compound estimation with both regular and scaled squared error losses. We develop theory to show that the class of NEB estimators enjoys strong asymptotic properties. Comprehensive simulation studies as well as analyses of real data examples are carried out to demonstrate the superiority of the NEB estimator over competing methods.

Statistics Theory,Methodology
A Penalized Empirical Likelihood Approach for Estimating Population Sizes under the Negative Binomial Regression Model

Yulu Ji,Yang Liu

DOI: https://doi.org/10.3390/math12172674

IF: 2.4

2024-08-31

Mathematics

Abstract:In capture–recapture experiments, the presence of overdispersion and heterogeneity necessitates the use of the negative binomial regression model for inferring population sizes. However, within this model, existing methods based on likelihood and ratio regression for estimating the dispersion parameter often face boundary and nonidentifiability issues. These problems can result in nonsensically large point estimates and unbounded upper limits of confidence intervals for the population size. We present a penalized empirical likelihood technique for solving these two problems by imposing a half-normal prior on the population size. Based on the proposed approach, a maximum penalized empirical likelihood estimator with asymptotic normality and a penalized empirical likelihood ratio statistic with asymptotic chi-square distribution are derived. To improve numerical performance, we present an effective expectation-maximization (EM) algorithm. In the M-step, optimization for the model parameters could be achieved by fitting a standard negative binomial regression model via the R basic function glm.nb(). This approach ensures the convergence and reliability of the numerical algorithm. Using simulations, we analyze several synthetic datasets to illustrate three advantages of our methods in finite-sample cases: complete mitigation of the boundary problem, more efficient maximum penalized empirical likelihood estimates, and more precise penalized empirical likelihood ratio interval estimates compared to the estimates obtained without penalty. These advantages are further demonstrated in a case study estimating the abundance of black bears (Ursus americanus) at the U.S. Army's Fort Drum Military Installation in northern New York.

mathematics
Berry-Esseen Bounds for Compound-Poisson Loss Percentiles

Frank Y. Feng,Michael R. Powers,Rui'an Xiao,Lin Zhao

DOI: https://doi.org/10.1080/03461238.2016.1182064

IF: 1.7821

2016-01-01

Scandinavian Actuarial Journal

Abstract:The Berry–Esseen (BE) theorem of probability theory is employed to establish bounds on percentile estimates for compound-Poisson loss portfolios. We begin by arguing that these bounds should not be based upon the exact BE constant, but rather upon a possibly lower, asymptotic counterpart for which the Lyapunov fraction converges uniformly to zero. We use this constant to construct two bounds – one approximate, and the other exact – and then propose a simple numerical criterion for determining whether the Gaussian approximation affords sufficient accuracy for a given Poisson mean and individual-loss distribution. Applying this criterion to the cases of gamma and lognormal individual losses, we find there exists a positive lower bound for the minimum Poisson mean necessary to achieve a fixed degree of accuracy for losses generated by the ‘best-case’ individual-loss distribution. Further investigation of this ‘best case’ reveals that large minimum Poisson means (i.e. 700) are required to achieve reasonable accuracy for the 99th percentile associated with these losses. Finally, we consider how the upper BE bound of a tail percentile may be applied to a common practical problem: selecting excess-of-loss reinsurance retentions.
Variance Estimation of the Buckley–James Estimator under Discrete Assumptions

Yishi Wang,Cuixian Chen,Fanhui Kong

DOI: https://doi.org/10.1080/00949650903421085

2011-01-01

Abstract:The Buckley-James estimator (BJE) is a widely recognized approach in dealing with right-censored linear regression models. There have been a lot of discussions in the literature on the estimation of the BJE as well as its asymptotic distribution. So far, no simulation has been done to directly estimate the asymptotic variance of the BJE. Kong and Yu [Asymptotic distributions of the Buckley-James estimator under nonstandard conditions, Statist. Sinica 17 (2007), pp. 341-360] studied the asymptotic distribution under discontinuous assumptions. Based on their methodology, we recalculate and correct some missing terms in the expression of the asymptotic variance in Theorem 2 of their work. We propose an estimator of the standard deviation of the BJE by using plug-in estimators. The estimator is shown to be consistent. The performance of the estimator is accessed through simulation studies under discrete underline distributions. We further extend our studies to several continuous underline distributions through simulation. The estimator is also applied to a real medical data set. The simulation results suggest that our estimation is a good approximation to the true standard deviation with reference to the empirical standard deviation.
Optimal empirical Bayes estimation for the Poisson model via minimum-distance methods

Soham Jana,Yury Polyanskiy,Yihong Wu

2024-05-08

Abstract:The Robbins estimator is the most iconic and widely used procedure in the empirical Bayes literature for the Poisson model. On one hand, this method has been recently shown to be minimax optimal in terms of the regret (excess risk over the Bayesian oracle that knows the true prior) for various nonparametric classes of priors. On the other hand, it has been long recognized in practice that Robbins estimator lacks the desired smoothness and monotonicity of Bayes estimators and can be easily derailed by those data points that were rarely observed before. Based on the minimum-distance distance method, we propose a suite of empirical Bayes estimators, including the classical nonparametric maximum likelihood, that outperform the Robbins method in a variety of synthetic and real data sets and retain its optimality in terms of minimax regret.

Statistics Theory,Methodology
Empirical Best Prediction for Small Area Inference with Binary Data

Jiming Jiang,P. Lahiri

DOI: https://doi.org/10.1023/a:1012410420337

2001-01-01

Annals of the Institute of Statistical Mathematics

Abstract:The paper introduces a frequentist's alternative to the recently developed hierarchical Bayes methods for small area estimation with binary data. Specifically, the best predictor (BP) and empirical best predictor (EBP) of small area specific random effect are developed in the context of a mixed logistic model and different asymptotic properties of the proposed BP and EBP are studied. An approximation to the mean squared error (MSE) of the proposed EBP correct up to the order o(m−1) is obtained, where m denotes the number of small areas. The asymptotic behavior of the relative savings loss (RSL) demonstrates the superiority of the proposed EBP over the usual small area proportion.

statistics & probability
Empirical Bayes estimates of steady-state availability in exponential distribution model

MEI Lian-zhen,ZHANG Guo-fen

DOI: https://doi.org/10.3321/j.issn:1008-9497.2007.03.008

2007-01-01

Abstract:Empirical Bayes procedure is used to estimate the steady-state availability in an exponential distribution model.The nonparametric polynomial density estimation of the unknown prior probability density function of the steady-state availability is considered.An example is given to study whether a nonparametric polynomial density estimation of the prior density function with a higher degree gives a significantly better estimate.
Empirical Bayes in Bayesian learning: understanding a common practice

Stefano Rizzelli,Judith Rousseau,Sonia Petrone

2024-02-29

Abstract:In applications of Bayesian procedures, even when the prior law is carefully specified, it may be delicate to elicit the prior hyperparameters so that it is often tempting to fix them from the data, usually by their maximum likelihood estimates (MMLE), obtaining a so-called empirical Bayes posterior distribution. Although questionable, this is a common practice; but theoretical properties seem mostly only available on a case-by-case basis. In this paper we provide general properties for parametric models. First, we study the limit behavior of the MMLE and prove results in quite general settings, while also conceptualizing the frequentist context as an unexplored case of maximum likelihood estimation under model misspecification. We cover both identifiable models, illustrating applications to sparse regression, and non-identifiable models - specifically, overfitted mixture models. Finally, we prove higher order merging results. In regular cases, the empirical Bayes posterior is shown to be a fast approximation to the Bayesian posterior distribution of the researcher who, within the given class of priors, has the most information about the true model's parameters. This is a faster approximation than classic Bernstein-von Mises results. Given the class of priors, our work provides formal contents to common beliefs on this popular practice.

Statistics Theory
Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates

Gourab Mukherjee,Lawrence D. Brown,Paat Rusmevichientong

DOI: https://doi.org/10.48550/arXiv.1511.00028

2016-06-23

Abstract:We develop a novel Empirical Bayes methodology for prediction under check loss in high-dimensional Gaussian models. The check loss is a piecewise linear loss function having differential weights for measuring the amount of underestimation or overestimation. Prediction under it differs in fundamental aspects from estimation or prediction under weighted-quadratic losses. Because of the nature of this loss, our inferential target is a pre-chosen quantile of the predictive distribution rather than the mean of the predictive distribution. We develop a new method for constructing uniformly efficient asymptotic risk estimates which are then minimized to produce effective linear shrinkage predictive rules. In calculating the magnitude and direction of shrinkage, our proposed predictive rules incorporate the asymmetric nature of the loss function and are shown to be asymptotically optimal. Using numerical experiments we compare the performance of our method with traditional Empirical Bayes procedures and obtain encouraging results.

Statistics Theory,Methodology
PAC-Bayesian Bounds for Randomized Empirical Risk Minimizers

Pierre Alquier

DOI: https://doi.org/10.3103/S1066530708040017

2009-01-09

Abstract:The aim of this paper is to generalize the PAC-Bayesian theorems proved by Catoni in the classification setting to more general problems of statistical inference. We show how to control the deviations of the risk of randomized estimators. A particular attention is paid to randomized estimators drawn in a small neighborhood of classical estimators, whose study leads to control the risk of the latter. These results allow to bound the risk of very general estimation procedures, as well as to perform model selection.

Machine Learning,Statistics Theory
Beta approximation for the two alleles Moran model by Stein's method

Jason Fulman

DOI: https://doi.org/10.1016/j.spl.2024.110051

IF: 0.718

2024-01-20

Statistics & Probability Letters

Abstract:In work on the two alleles Moran model, Ewens showed that the stationary distribution for the number of genes of one type can be approximated by a Beta distribution. In this short note, we provide a sharp error term for this approximation. We show that this example fits perfectly into Döbler's framework for Beta approximation by Stein's method of exchangeable pairs.

statistics & probability
Confidence Intervals for Nonparametric Empirical Bayes Analysis

Nikolaos Ignatiadis,Stefan Wager

DOI: https://doi.org/10.48550/arXiv.1902.02774

2021-09-09

Abstract:In an empirical Bayes analysis, we use data from repeated sampling to imitate inferences made by an oracle Bayesian with extensive knowledge of the data-generating distribution. Existing results provide a comprehensive characterization of when and why empirical Bayes point estimates accurately recover oracle Bayes behavior. In this paper, we develop flexible and practical confidence intervals that provide asymptotic frequentist coverage of empirical Bayes estimands, such as the posterior mean or the local false sign rate. The coverage statements hold even when the estimands are only partially identified or when empirical Bayes point estimates converge very slowly.

Methodology
EM Estimation for the Poisson-Inverse Gamma Regression Model with Varying Dispersion: An Application to Insurance Ratemaking

George Tzougas

DOI: https://doi.org/10.3390/risks8030097

2020-09-11

Risks

Abstract:This article presents the Poisson-Inverse Gamma regression model with varying dispersion for approximating heavy-tailed and overdispersed claim counts. Our main contribution is that we develop an Expectation-Maximization (EM) type algorithm for maximum likelihood (ML) estimation of the Poisson-Inverse Gamma regression model with varying dispersion. The empirical analysis examines a portfolio of motor insurance data in order to investigate the efficiency of the proposed algorithm. Finally, both the a priori and a posteriori, or Bonus-Malus, premium rates that are determined by the Poisson-Inverse Gamma model are compared to those that result from the classic Negative Binomial Type I and the Poisson-Inverse Gaussian distributions with regression structures for their mean and dispersion parameters.
Consistent least squares estimation in population-size-dependent branching processes

Peter Braunsteins,Sophie Hautphenne,Carmen Minuesa

2024-12-04

Abstract:We derive the first conditionally consistent estimators for a class of parametric Markov population models with logistic growth, which are suitable for modelling endangered populations in restricted habitats with a carrying capacity. We focus on discrete-time parametric population-size-dependent branching processes, for which we propose a new class of weighted least-squares estimators based on a single trajectory of population size counts. We establish the consistency and asymptotic normality of our estimators, conditional on non-extinction up to time $n$, as $n\to\infty$. Since Markov population models with a carrying capacity become extinct almost surely under general conditions, our proofs rely on arguments distinct from those in the existing literature. Our results are motivated by conservation biology, where endangered populations are often studied precisely because they are still alive, leading to an observation bias. Through simulated examples, we show that our conditionally consistent estimators generally reduce this bias for key quantities such as a habitat's carrying capacity. We apply our methodology to estimate the carrying capacity of the Chatham Island black robin, a population reduced to a single breeding female in the 1970's, which has since recovered but has yet to reach the island's carrying capacity.

Statistics Theory,Probability
Bayesian Estimation and Prediction for Exponentiated Inverted Topp-Leone Distribution

Amira Albadawy,Eman Ashour,Abeer A. EL-Helbawy,Gannat R. AL-Dayian,Abeer EL-Helbawy,Gannat AL-Dayian

DOI: https://doi.org/10.21608/cjmss.2023.241890.1022

2024-04-01

Abstract:This paper focuses on Bayesian estimation for the shape parameters, reliability and hazard rate functions of the exponentiated inverted distribution. Bayesian estimation is performed under two different loss functions. The Bayes estimators are derived under the squared error loss function as a symmetric loss function and the linear-exponential loss function as an asymmetric loss function, based on Type II censored sample. Credible intervals for the parameters, reliability and hazard rate functions are derived. The Bayesian two-sample prediction (point and interval) for a future observation from independent future sample from the same distribution, exponentiated inverted Topp-Leone distribution, is obtained based on Type II censored sample. Numerical illustration is proposed, and some interesting comparisons are presented to investigate the theoretical results through some measurements of accuracy. Moreover, the results are applied to real data set to ensure the theoretical results and to prove the applicability of the exponentiated inverted Topp-Leone distribution in real life.

Empirical Bayes estimators for the reproduction parameter of Borel-Tanner distribution

Empirical Bayes Estimators of Risk Premium under Variance Related Premium Principle

A robust multivariate Birnbaum–Saunders distribution: EM estimation

Empirical Bayes When Estimation Precision Predicts Parameters

Empirical Bayes via ERM and Rademacher complexities: the Poisson model

The empirical Bayes estimators of the rate parameter of the gamma distribution with a conjugate gamma prior under Stein's loss function

A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family

A Penalized Empirical Likelihood Approach for Estimating Population Sizes under the Negative Binomial Regression Model

Berry-Esseen Bounds for Compound-Poisson Loss Percentiles

Variance Estimation of the Buckley–James Estimator under Discrete Assumptions

Optimal empirical Bayes estimation for the Poisson model via minimum-distance methods

Empirical Best Prediction for Small Area Inference with Binary Data

Empirical Bayes estimates of steady-state availability in exponential distribution model

Empirical Bayes in Bayesian learning: understanding a common practice

Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates

PAC-Bayesian Bounds for Randomized Empirical Risk Minimizers

Beta approximation for the two alleles Moran model by Stein's method

Confidence Intervals for Nonparametric Empirical Bayes Analysis

EM Estimation for the Poisson-Inverse Gamma Regression Model with Varying Dispersion: An Application to Insurance Ratemaking

Consistent least squares estimation in population-size-dependent branching processes

Bayesian Estimation and Prediction for Exponentiated Inverted Topp-Leone Distribution