Abstract:Bagging an estimator approximately doubles its bias through the impact of bagging on quadratic terms in expansions of the estimator. This dicult y can be alleviated by bagging a suitably bias-corrected estimator, however. In these and other circumstances, what is the overall impact of bagging and/or bias cor- rection, and how can it be characterised? We answer these questions in the case of general estimators dened by estimating equations, including for example max- imum likelihood and method of moments estimators. It is shown that, despite the considerable variety of estimators that can be constructed by bagging and bias cor- rection, the number of modes of behaviour is very small. In particular, bagging a bias-corrected estimator produces a new estimator that is second-order equivalent to the original, unadjusted estimator. Furthermore, the conventional bagged es- timator, and the standard bias-corrected estimator, represent virtually equal but opposite adjustments of the conventional estimator. In particular, bagging adds back the adjustment provided by bias correction. If we bag a doubly bias corrected estimator, constructed so as to counteract the tendency of bagging to exacerbate bias, then the result is an estimator that is second-order equivalent to the standard bias-corrected estimator. These results do not depend on the manner of bias cor- rection; that procedure may be implemented using the jackknife, the parametric bootstrap or the nonparametric bootstrap. They show that, when bagging is ap- plied to relatively conventional statistical problems, it cannot reliably be expected to improve performance. Its domain is, in eect, restricted to problems such as regression trees, where variability is so high that it cannot be plausibly modelled using the approach taken here.

Bias-Correction Methods for the Unit Exponential Distribution and Applications

Wild bootstrap inference for penalized quantile regression for longitudinal data

Effects of Bagging and Bias Correction on Estimators Defined by Estimating Equations

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Estimating the failure rate of the log-logistic distribution by smooth adaptive and bias-correction methods

Robust Estimating Functions and Bias Correction for Longitudinal Data Analysis

Bias correction for multiple covariate analysis using empirical bayesian estimation in mixed-effects models for longitudinal data

Bias Correction and Refined Inferences for Fixed Effects Spatial Panel Data Models

Bias Correction for Fixed Effects Spatial Panel Data Models

Bias correction of posterior means using MCMC outputs

Parameters Estimation and Bias Correction 1 for Diusion Processes

Parameter Estimation and Bias Correction for Diffusion Processes

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Comparing Alternative Corrections for Bias in the Bias-Corrected Bootstrap Test of Mediation

Maximum Likelihood Estimations and EM Algorithms with Length-biased Data

ASYMPTOTIC THEORY OF A BIAS-CORRECTED LEAST-SQUARES ESTIMATOR IN TRUNCATED REGRESSION

A simulation-based estimation method for bias reduction

Unbiased Test Error Estimation in the Poisson Means Problem via Coupled Bootstrap Techniques

Bootstrap Methods for Bias-Correcting Probability Distribution Parameters Characterizing Extreme Snow Accumulations

The maximum likelihood estimator under the exponential distribution with right-censored linear regression data

Robust small area estimation for unit level model with density power divergence