Abstract:The bootstrap is a widely used procedure for statistical inference because of its simplicity and attractive statistical properties. However, the vanilla version of bootstrap is no longer feasible computationally for many modern massive datasets due to the need to repeatedly resample the entire data. Therefore, several improvements to the bootstrap method have been made in recent years, which assess the quality of estimators by subsampling the full dataset before resampling the subsamples. Naturally, the performance of these modern subsampling methods is influenced by tuning parameters such as the size of subsamples, the number of subsamples, and the number of resamples per subsample. In this article, we develop a novel hyperparameter selection methodology for selecting these tuning parameters. Formulated as an optimization problem to find the optimal value of some measure of accuracy of an estimator subject to computational cost, our framework provides closed-form solutions for the optimal hyperparameter values for subsampled bootstrap, subsampled double bootstrap and bag of little bootstraps, at no or little extra time cost. Using the mean square errors as a proxy of the accuracy measure, we apply our methodology to study, compare and improve the performance of these modern versions of bootstrap developed for massive data through numerical study. The results are promising.

Bootstrapping Endpoint

Bootstrapping Estimators based on the Block Maxima Method

Wild bootstrap inference for penalized quantile regression for longitudinal data

Bootstrap Inference for Panel Data Quantile Regression

The Limit Distribution of the Bootstrap for the Unit Root Test Statistic when the Residuals Are Dependent

Study on Small Scale Sample Test Estimation Method Based on Bootstrap Method

The nonparametric bootstrap for the current status model

Consistency of the bootstrap for asymptotically linear estimators based on machine learning

The Big Data Bootstrap

The resampling method via representative points

Bootstrap and Maximum Entropy Based Small-sample Product Lifetime Probability Distribution

Bootstrap estimation of the proportion of outliers in robust regression

Bootstrapping time series models

Deterministic bootstrapping for a class of bootstrap methods

A Subsampled Double Bootstrap for Massive Data

Bootstrap methods for stationary functional time series

Bootstrap inference for the finite population total under complex sampling designs

On the consistency of bootstrap for matching estimators

Optimal Subsampling Bootstrap for Massive Data

Bootstrap algorithms for small samples

On the Assessment of Bootstrap Intervals for Samples of Fixed Size