Abstract:Bagging an estimator approximately doubles its bias through the impact of bagging on quadratic terms in expansions of the estimator. This dicult y can be alleviated by bagging a suitably bias-corrected estimator, however. In these and other circumstances, what is the overall impact of bagging and/or bias cor- rection, and how can it be characterised? We answer these questions in the case of general estimators dened by estimating equations, including for example max- imum likelihood and method of moments estimators. It is shown that, despite the considerable variety of estimators that can be constructed by bagging and bias cor- rection, the number of modes of behaviour is very small. In particular, bagging a bias-corrected estimator produces a new estimator that is second-order equivalent to the original, unadjusted estimator. Furthermore, the conventional bagged es- timator, and the standard bias-corrected estimator, represent virtually equal but opposite adjustments of the conventional estimator. In particular, bagging adds back the adjustment provided by bias correction. If we bag a doubly bias corrected estimator, constructed so as to counteract the tendency of bagging to exacerbate bias, then the result is an estimator that is second-order equivalent to the standard bias-corrected estimator. These results do not depend on the manner of bias cor- rection; that procedure may be implemented using the jackknife, the parametric bootstrap or the nonparametric bootstrap. They show that, when bagging is ap- plied to relatively conventional statistical problems, it cannot reliably be expected to improve performance. Its domain is, in eect, restricted to problems such as regression trees, where variability is so high that it cannot be plausibly modelled using the approach taken here.

Estimating POT Second-order Parameter for Bias Correction

Bias Reduced Peaks over Threshold Tail Estimation

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Barankin Bound for Bearing Estimation with Bias Correction

A Bound on Mean-Square Estimation Error with Background Parameter Mismatch

POT-flavored estimator of Pickands dependence function

Nonparametric estimator of the tail dependence coefficient: balancing bias and variance

Empirical Likelihood Based Inference for Conditional Pareto-type Tail Index

Performance Bound Approximation for Bearing Estimation with Bias Correction

Bias-Corrected Peaks-Over-Threshold Estimation of the CVaR

Effects of Bagging and Bias Correction on Estimators Defined by Estimating Equations

Bias Reduction for High Quantiles

On Second Order Conditions in the Multivariate Block Maxima and Peak over Threshold Method

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robust Estimating Equations and Bias Correction of Correlation Parameters for Longitudinal Data

Statistical Inference and Application of Asymmetrical Generalized Pareto Distribution Based on Peaks-Over-Threshold Model

Asymptotic theory for Bayesian inference and prediction: from the ordinary to a conditional Peaks-Over-Threshold method

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Robust estimation of Pareto-type tail index through an exponential regression model

Reduced-bias estimation of the residual dependence index with unnamed marginals