Abstract:Bagging an estimator approximately doubles its bias through the impact of bagging on quadratic terms in expansions of the estimator. This dicult y can be alleviated by bagging a suitably bias-corrected estimator, however. In these and other circumstances, what is the overall impact of bagging and/or bias cor- rection, and how can it be characterised? We answer these questions in the case of general estimators dened by estimating equations, including for example max- imum likelihood and method of moments estimators. It is shown that, despite the considerable variety of estimators that can be constructed by bagging and bias cor- rection, the number of modes of behaviour is very small. In particular, bagging a bias-corrected estimator produces a new estimator that is second-order equivalent to the original, unadjusted estimator. Furthermore, the conventional bagged es- timator, and the standard bias-corrected estimator, represent virtually equal but opposite adjustments of the conventional estimator. In particular, bagging adds back the adjustment provided by bias correction. If we bag a doubly bias corrected estimator, constructed so as to counteract the tendency of bagging to exacerbate bias, then the result is an estimator that is second-order equivalent to the standard bias-corrected estimator. These results do not depend on the manner of bias cor- rection; that procedure may be implemented using the jackknife, the parametric bootstrap or the nonparametric bootstrap. They show that, when bagging is ap- plied to relatively conventional statistical problems, it cannot reliably be expected to improve performance. Its domain is, in eect, restricted to problems such as regression trees, where variability is so high that it cannot be plausibly modelled using the approach taken here.

Bias correction for eta squared in one-way ANOVA

Effects of Bagging and Bias Correction on Estimators Defined by Estimating Equations

Comparing Alternative Corrections for Bias in the Bias-Corrected Bootstrap Test of Mediation

Bias correction of posterior means using MCMC outputs

Bias-Correction Methods for the Unit Exponential Distribution and Applications

Bias Correction Estimator for A Dynamic Panel Data Model with Fixed Effects Using an Iterated Bootstrap

Efficient estimation and correction of selection-induced bias with order statistics

Bias correction of quadratic spectral estimators

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Bias-Corrected Estimators of Scalar Skew Normal

Bootstrap Inference for Fixed‐Effect Models

Bias Correction for Fixed Effects Spatial Panel Data Models

Bias correction for multiple covariate analysis using empirical bayesian estimation in mixed-effects models for longitudinal data

Bias Reduction in Sample-Based Optimization

Bias in Estimates of Quantitative-Trait–Locus Effect in Genome Scans: Demonstration of the Phenomenon and a Method-of-Moments Procedure for Reducing Bias

Bias Correction and Refined Inferences for Fixed Effects Spatial Panel Data Models

A Parametric Bootstrap Approach for One-Way ANOVA Under Unequal Variances with Unbalanced Data.

Correction of overfitting bias in regression models

Robust Estimating Functions and Bias Correction for Longitudinal Data Analysis

Bias-corrected Random Forests in Regression

ASYMPTOTIC THEORY OF A BIAS-CORRECTED LEAST-SQUARES ESTIMATOR IN TRUNCATED REGRESSION