Asymptotically Optimal Empirical Bayes Decision

WANG Li-chun,WEI Lai-sheng

2006-01-01

Abstract:In this paper,a Bayes decision rule is derived for the scale-exponential family with error in variables,and an empirical Bayes (EB) decision rule is constructed by a deconvolution kernel method.Under suitable conditions,it is shown that the EB decision rule is asymptotically optimal.

What problem does this paper attempt to address?

Asymptotically Optimal Empirical Bayes Decision

WANG Li-chun,WEI Lai-sheng

DOI: https://doi.org/10.3969/j.issn.1001-9847.2006.02.021

2006-01-01

Abstract:In this paper,a Bayes decision rule is derived for the scale-exponential family with error in variables,and an empirical Bayes (EB) decision rule is constructed by a deconvolution kernel method. Under suitable conditions,it is shown that the EB decision rule is asymptotically optimal.
Empirical Bayes Test for Scale Exponential Family

Wei Li,Wei Lai-sheng

DOI: https://doi.org/10.1007/s11464-006-0010-1

2006-01-01

Frontiers of Mathematics in China

Abstract:In this paper, we consider the empirical Bayes (EB) test problem for the scale parameters in the scale exponential family with a weighted linear loss function. The EB test rules are constructed by the kernel estimation method. The asymptotical optimality and convergence rates of the EB test rules are obtained. The main results are illustrated by applying the proposed test to type II censored data from the exponential distribution and to the test problem for the dispersion parameter in the linear regression model.
Empirical Bayes Estimation For The Scale Parameter With Errors In Variables

Lichun Wang,Laisheng Wei

2010-01-01

Southeast Asian Bulletin of Mathematics

Abstract:This paper considers the empirical Bayes estimation problem for the scale-exponential family with errors in variables. Under the weighted square loss, the Bayes estimator of the scale parameter is derived and the empirical Bayes (EB) estimator is constructed via a deconvolution kernel method. We prove the asymptotic optimality of the proposed EB estimator and also present a simulation study to compare the performances of the EB estimator under two different error distributions.
The convergence rates for empirical bayes test of the parameter in scale exponential family

Li WEI,Sheng-Chun KONG,Lai-Sheng WEI

DOI: https://doi.org/10.3969/j.issn.1002-1175.2007.01.002

2007-01-01

Abstract:In this paper, the empirical Bayes (EB) test problem of the parameter for scale exponential family under weighed linear loss functions is discussed.The EB test rules is constructed by the kernel estimation method based on Bessel functions.Under suitable conditions the proposed EB test rules are asymptotically optimal with the convergence rate O(n -1 (ln n)6). Finally,an example satisfying the conditions of the theorem is shown.
The Empirical Bayes Test Problem of Parameter for Scale Exponential Family

魏莉,韦来生

DOI: https://doi.org/10.3969/j.issn.0253-2778.2004.01.001

2004-01-01

Journal of University of Science and Technology of China

Abstract:In this paper,the empirical Bayes (EB) test problem of parameter for scale exponential family under weighed linear loss function has been discussed. The EB test rules are constructed by kernel estimation method. The asymptotically optimality and convergence rates of EB test rules are obtained. Finally, two applications of the main results are shown.
THE CONVERGENCE RATES OF EMPIRICAL BAYES ESTIMATION OF THE PARAMETER FOR SCALE-EXPONENTIAL FAMILY

王立春,韦来生

DOI: https://doi.org/10.3321/j.issn:1000-8134.2002.05.002

2002-01-01

Abstract:The Bayes estimator is derived under weighted square loss function and empirical Bayes (EB) estimators of the parameter are constructed for the scale exponential family. It is shown that the proposed EB estimators are asymptotically optimal with convergence ratesO(n), where 1/2 λ 1, and s 3 is a given integer. Finally, two applications are eiven.
ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION FOR THE PARAMETERS OF MULTI-PARAMETER DISCRETE EXPONENTIAL FAMILY

YN Yang,LS Wei

DOI: https://doi.org/10.1016/s0252-9602(17)30773-7

1996-01-01

Acta Mathematica Scientia

Abstract:For the multi-parameter discrete exponential family, we construct an empirical Bayes (EB) estimator of the vector-valued parameter theta. Under some conditions, this estimator is proved to be asymptotically optimal.
Empirical Bayes Test for Two-parameter Exponential Distribution under Type-II Censored Samples

Liang Wang

2012-01-01

Abstract:The empirical Bayes test problem is considered for scale parameter of twoparameter exponential distribution under type-II censored data.By using wavelets estimation method,the EB test function is constructed,of which the asymptotic optimality and convergence rates are obtained.Finally,an example concerning the main result is given.
Maximum Score Estimation of Preference Parameters for a Binary Choice Model under Uncertainty

Le-Yu Chen,Sokbae Lee,Myung Jae Sung

DOI: https://doi.org/10.48550/arXiv.1304.5747

2013-12-03

Abstract:This paper develops maximum score estimation of preference parameters in the binary choice model under uncertainty in which the decision rule is affected by conditional expectations. The preference parameters are estimated in two stages: we estimate conditional expectations nonparametrically in the first stage and then the preference parameters in the second stage based on Manski (1975, 1985)'s maximum score estimator using the choice data and first stage estimates. The paper establishes consistency and derives rate of convergence of the two-stage maximum score estimator. Moreover, the paper also provides sufficient conditions under which the two-stage estimator is asymptotically equivalent in distribution to the corresponding single-stage estimator that assumes the first stage input is known. These results are of independent interest for maximum score estimation with nonparametrically generated regressors. The paper also presents some Monte Carlo simulation results for finite-sample behavior of the two-stage estimator.

Methodology,Statistics Theory
EMPIRICAL BAYES TEST PROBLEMS OF VARIANCE COMPONENTS IN RANDOM EFFECTS MODEL

LS Wei,WP Zhang

DOI: https://doi.org/10.1016/s0252-9602(17)30284-9

2005-01-01

Acta Mathematica Scientia

Abstract:Bayes decision rule of variance components for one-way random effects model is derived and empirical Bayes (EB) decision rules are constructed by kernel estimation method. Under suitable conditions, it is shown that the proposed EB decision rules are asymptotically optimal with convergence rates near O(n(-1/2)). Finally, an example concerning the main result is given.
Improvement of convergence rates for the empirical Bayes test problem in scale exponential family

ZHOU Yan,Wei Lai-sheng

DOI: https://doi.org/10.3969/j.issn.1000-4424.2008.02.014

2008-01-01

Abstract:The monotone Bayes test rules for scale exponential family are derived under weighted linear loss function,the EB test rules are constructed by using kernel estimation method in the case of negatively associated (NA) samples,and the convergence rates are obtained.The convergence rates for the proposed EB test rules can be arbitrarily close to O(n~(-1)) under suitable conditions,which has improved the given result in the literature.Similar results can be obtained for the cases of the positively associated (PA) samples and lid samples.Finally,an example concerning main results is given.
Empirical Bayes two-sided test problem based on type Ⅱ censored samples in the exponential distribution

HONG Jian,WEI Lai-sheng

DOI: https://doi.org/10.3969/j.issn.0253-2778.2006.12.007

2006-01-01

Journal of University of Science and Technology of China

Abstract:The empirical Bayes(EB) two-sided test problem of the failure function based on type Ⅱ censored samples in the exponential distribution was studied.The EB test rule was constructed by the kernel estimation of probability density function and its derivatives.Under suitable conditions,it is shown that the proposed EB test rules are asymptotically optimal with convergence rates near O(n~(-1/2)).Finally,an example satisfying the conditions of the theorem was given.
Asymptotically Optimal Empirical Bayes Estimation for Variance Components in Random Effects Models

韦来生,王立春

DOI: https://doi.org/10.3770/j.issn.2095-2651.2004.04.009

2004-01-01

Abstract:In this paper, the Bayes estimators of variance components for two-way classification random effects models is derived under weighted quadratic loss function, and the empirical Bayes (EB) estimators are constructed by the kernel estimation of multivariate density and its mixed partial derivatives. The asymptotically optimality of the EB estimators are obtained under some suitable conditions, and the special cases and the generalizations of the model are shown. Finally, an example satisfying the conditions of theorem is given.
Asymptotic Representations for Sequential Decisions, Adaptive Experiments, and Batched Bandits

Keisuke Hirano,Jack R. Porter

DOI: https://doi.org/10.48550/arXiv.2302.03117

2023-02-06

Econometrics

Abstract:We develop asymptotic approximation results that can be applied to sequential estimation and inference problems, adaptive randomized controlled trials, and other statistical decision problems that involve multiple decision nodes with structured and possibly endogenous information sets. Our results extend the classic asymptotic representation theorem used extensively in efficiency bound theory and local power analysis. In adaptive settings where the decision at one stage can affect the observation of variables in later stages, we show that a limiting data environment characterizes all limit distributions attainable through a joint choice of an adaptive design rule and statistics applied to the adaptively generated data, under local alternatives. We illustrate how the theory can be applied to study the choice of adaptive rules and end-of-sample statistical inference in batched (groupwise) sequential adaptive experiments.
On Empirical Bayes Estimation of Variance Components in Random Effects Model

LS Wei,X Ding

DOI: https://doi.org/10.1016/s0378-3758(03)00152-6

IF: 1.095

2004-01-01

Journal of Statistical Planning and Inference

Abstract:In this paper, Bayes estimators of variance components are derived for the one-way random effects model, and empirical Bayes (EB) estimators are constructed by the kernel estimation method of a multivariate density and its mixed partial derivatives. It is shown that the EB estimators are asymptotically optimal and convergence rates are established. Finally, an example concerning the main results is given.
THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

Zhang Shunpu,Wei Laisheng

DOI: https://doi.org/10.1007/bf02663774

1994-01-01

Abstract:Empirical Bayes estimation of the parameter vector θ=(β’,σ2)’ in a multiple linear regression modelY=Xβ+ε is considered, where β is the vector of regression coefficient, ε∽N(0,σI with σ2 unknown. In this paper, we construct the EB estimators of θ by using the kernel estimation of multivariate density function and its partial derivatives. Under some moment conditions on prior distribution we obtain their asymptotic optimality.
Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates

Gourab Mukherjee,Lawrence D. Brown,Paat Rusmevichientong

DOI: https://doi.org/10.48550/arXiv.1511.00028

2016-06-23

Abstract:We develop a novel Empirical Bayes methodology for prediction under check loss in high-dimensional Gaussian models. The check loss is a piecewise linear loss function having differential weights for measuring the amount of underestimation or overestimation. Prediction under it differs in fundamental aspects from estimation or prediction under weighted-quadratic losses. Because of the nature of this loss, our inferential target is a pre-chosen quantile of the predictive distribution rather than the mean of the predictive distribution. We develop a new method for constructing uniformly efficient asymptotic risk estimates which are then minimized to produce effective linear shrinkage predictive rules. In calculating the magnitude and direction of shrinkage, our proposed predictive rules incorporate the asymmetric nature of the loss function and are shown to be asymptotically optimal. Using numerical experiments we compare the performance of our method with traditional Empirical Bayes procedures and obtain encouraging results.

Statistics Theory,Methodology
Empirical Bayes Estimation and Its Superiority for Two-Way Classification Model

LS Wei,JH Chen

DOI: https://doi.org/10.1016/s0167-7152(03)00079-8

IF: 0.718

2003-01-01

Statistics & Probability Letters

Abstract:Consider a two-way classification model, and let α and β be the vectors of treatment effects of two factors A and B under investigation. We discuss the problem of constructing Bayes and empirical Bayes (EB) estimators of the linear functions of α and β. Under general conditions, EB estimators are found to have smaller mean square error matrix than the least sum of squares solutions.
Asymptotically optimal nonparametric empirical Bayes via predictive recursion

Ryan Martin

DOI: https://doi.org/10.48550/arXiv.1210.5235

2012-10-19

Abstract:An empirical Bayes problem has an unknown prior to be estimated from data. The predictive recursion (PR) algorithm provides fast nonparametric estimation of mixing distributions and is ideally suited for empirical Bayes applications. This paper presents a general notion of empirical Bayes asymptotic optimality, and it is shown that PR-based procedures satisfy this property under certain conditions. As an application, the problem of in-season prediction of baseball batting averages is considered. There the PR-based empirical Bayes rule performs well in terms of prediction error and ability to capture the distribution of the latent features.

Statistics Theory
A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family

Trambak Banerjee,Qiang Liu,Gourab Mukherjee,Wenguang Sun

DOI: https://doi.org/10.48550/arXiv.1910.08997

2019-10-20

Abstract:We develop a Nonparametric Empirical Bayes (NEB) framework for compound estimation in the discrete linear exponential family, which includes a wide class of discrete distributions frequently arising from modern big data applications. We propose to directly estimate the Bayes shrinkage factor in the generalized Robbins' formula via solving a scalable convex program, which is carefully developed based on a RKHS representation of the Stein's discrepancy measure. The new NEB estimation framework is flexible for incorporating various structural constraints into the data driven rule, and provides a unified approach to compound estimation with both regular and scaled squared error losses. We develop theory to show that the class of NEB estimators enjoys strong asymptotic properties. Comprehensive simulation studies as well as analyses of real data examples are carried out to demonstrate the superiority of the NEB estimator over competing methods.

Statistics Theory,Methodology

Asymptotically Optimal Empirical Bayes Decision

Asymptotically Optimal Empirical Bayes Decision

Empirical Bayes Test for Scale Exponential Family

Empirical Bayes Estimation For The Scale Parameter With Errors In Variables

The convergence rates for empirical bayes test of the parameter in scale exponential family

The Empirical Bayes Test Problem of Parameter for Scale Exponential Family

THE CONVERGENCE RATES OF EMPIRICAL BAYES ESTIMATION OF THE PARAMETER FOR SCALE-EXPONENTIAL FAMILY

ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION FOR THE PARAMETERS OF MULTI-PARAMETER DISCRETE EXPONENTIAL FAMILY

Empirical Bayes Test for Two-parameter Exponential Distribution under Type-II Censored Samples

Maximum Score Estimation of Preference Parameters for a Binary Choice Model under Uncertainty

EMPIRICAL BAYES TEST PROBLEMS OF VARIANCE COMPONENTS IN RANDOM EFFECTS MODEL

Improvement of convergence rates for the empirical Bayes test problem in scale exponential family

Empirical Bayes two-sided test problem based on type Ⅱ censored samples in the exponential distribution

Asymptotically Optimal Empirical Bayes Estimation for Variance Components in Random Effects Models

Asymptotic Representations for Sequential Decisions, Adaptive Experiments, and Batched Bandits

On Empirical Bayes Estimation of Variance Components in Random Effects Model

THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates

Empirical Bayes Estimation and Its Superiority for Two-Way Classification Model

Asymptotically optimal nonparametric empirical Bayes via predictive recursion

A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family