A Large Sample Study of Randomly Weighted Bootstrap in Linear Models

Yaohua Wu,Lincheng Zao

DOI: https://doi.org/10.1007/bf02889508

1999-01-01

Science China Mathematics

Abstract:The method of randomly weighted bootstrap is used to derive the approximation ofM-estimates in linear models. It is shown that the approximation is asymptotically valid under some mild conditions.

What problem does this paper attempt to address?

Asymptotic Efficiency of Randomly Weighted Bootstrap for Linear Models

Yaohua Wu,Lincheng Zhao

DOI: https://doi.org/10.1007/bf02898942

1998-01-01

Abstract:This note discusses the method of randomly weighted bootstrap to derive the approximation of M-estimates in linear models, and shows that the approximation is asymptotically valid under some mild conditions.
Approximation to the Distribution of Least Distances Estimate in Multivariate Linear Models by Randomly Weighted Bootstrap

WU Yao-hua,CAO Yi

DOI: https://doi.org/10.3969/j.issn.0253-2778.2006.09.003

2006-01-01

Abstract:The method of randomly weighted bootstrap was used to derive the approximation to the distribution of least distances estimate(LDE)in multivariate linear models.It is shown that the approximation is asymptotically valid under some mild conditions.
APPROXIMATING THE DISTRIBUTION OF M-ESTIMATORS IN LINEAR MODELS BY RANDOMLY WEIGHTED BOOTSTRAP

吴小燕,赵林城,杨亚宁

DOI: https://doi.org/10.12341/jssms10175

2008-01-01

Abstract:The asymptotic distribution of the M-estimators are generally related to quan- tities of the error distribution that can not be conveniently estimated.The randomly weighted bootstrap method provides a way of assessing the distribution of the M-estimators without estimating the nuisance quantities of the error distributions.In this paper,the distribution of M-estimators is approximated by the randomly weighted bootstrap method in linear models when the covariates are random.It is shown that the randomly weighted bootstrapping estima- tion of the distribution of the M-estimator is uniformly consistent.Also,the variance estimates is investigated by Monte Carlo simulations for different choices of the convex function,sample size and random weights.Poisson weighting is recommended for reducing the computational burden in the randomly weighted bootstrapping M-estimators.
Approximation by Random Weighting Method for M-test in Linear Models

Xiao-yan Wu,Ya-ning Yang,Lin-cheng Zhao

DOI: https://doi.org/10.1007/s11425-007-2022-z

2007-01-01

Science in China Series A Mathematics

Abstract:The M-test has been in common use and widely studied in testing the linear hypotheses in linear models. However, the critical value for the test is usually related to the quantities of the unknown error distribution and the estimate of the nuisance parameters may be rather involved, not only for the M-test method but also for the existing bootstrap methods. In this paper we suggest a random weighting resampling method for approximating the null distribution of the M-test statistic. It is shown that, under both the null and the local alternatives, the random weighting statistic has the same asymptotic distribution as the null distribution of the M-test. The critical values of the M-test can therefore be obtained by the random weighting method without estimating the nuisance parameters. A distinguished feature of the proposed method is that the approximation is valid even the null hypothesis is not true and the power evaluation is possible under the local alternatives.
Wild bootstrap inference for penalized quantile regression for longitudinal data

Carlos Lamarche,Thomas Parker

DOI: https://doi.org/10.1016/j.jeconom.2022.11.011

IF: 3.363

2023-02-04

Journal of Econometrics

Abstract:The existing theory of penalized quantile regression for longitudinal data has focused primarily on point estimation. In this work, we investigate statistical inference. We propose a wild residual bootstrap procedure and show that it is asymptotically valid for approximating the distribution of the penalized estimator. The model puts no restrictions on individual effects, and the estimator achieves consistency by letting the shrinkage decay in importance asymptotically. The new method is easy to implement and simulation studies show that it has accurate small sample behavior in comparison with existing procedures. Finally, we illustrate the new approach using U.S. Census data to estimate a model that includes more than eighty thousand parameters.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications
Bootstrap Inference for Panel Data Quantile Regression

Antonio F. Galvao,Thomas Parker,Zhijie Xiao

DOI: https://doi.org/10.1080/07350015.2023.2210189

2023-06-04

Journal of Business and Economic Statistics

Abstract:This article develops bootstrap methods for practical statistical inference in panel data quantile regression models with fixed effects. We consider random-weighted bootstrap resampling and formally establish its validity for asymptotic inference. The bootstrap algorithm is simple to implement in practice by using a weighted quantile regression estimation for fixed effects panel data. We provide results under conditions that allow for temporal dependence of observations within individuals, thus, encompassing a large class of possible empirical applications. Monte Carlo simulations provide numerical evidence the proposed bootstrap methods have correct finite sample properties. Finally, we provide an empirical illustration using the environmental Kuznets curve.

statistics & probability,social sciences, mathematical methods,economics
Approximation to the Distribution of the Least Squares Estimators in Two Dimensional Cosine Models by Randomly Weighted Bootstrap

Yuan-yuan Zhao,Rui-xing Ming,Yao-hua Wu

DOI: https://doi.org/10.1007/s10255-013-0254-y

2013-01-01

Abstract:Recently, Kundu and Gupta (Metrika, 48: 83 C 97, 1998) established the asymptotic normality of the least squares estimators in the two dimensional cosine model. In this paper, we give the approximation to the general least squares estimators by using random weights which is called the Bayesian bootstrap or the random weighting method by Rubin (Annals of Statistics, 9: 130 C 134, 1981) and Zheng (Acta Math. Appl. Sinica (in Chinese), 10 (2): 247 C 253, 1987). A simulation study shows that this approximation works very well.
Weighted Bootstrap Inference on Censored Regression Model

Shu-ran ZHAO,Xing-zhong XU,Pei-min REN

2008-01-01

Abstract:Regression model with censored data is studied. Based on synthetic data, weighted bootstrap is used to approximate the sample distribution of regression coefficient. For general choices of random weights, the validity of such a distribution approximation and the weak consistency of weighted bootstrap estimate to regression coefficient are established. A weighted bootstrap confidence interval for regression coefficient is then constructed. Simulation studies were conducted to compare the weighted bootstrap interval with the interval based on normal approximation and showed that the former is superior to the latter in terms of coverage probability.
Study on Small Scale Sample Test Estimation Method Based on Bootstrap Method

Huang Wei,Feng Yunwen,Lü Zhenzhou

DOI: https://doi.org/10.3321/j.issn:1003-8728.2006.01.011

2006-01-01

Abstract:The objective of this paper is to present a method that can be used to improve the conventional Bootstrap method.In the past,the Bootstrap method was for estimating small sample tests.Firstly,we point out the shortcomings of the Bootstrap method that Bootstrap random samples are confined to original samples.In particular,the maximum value and the minimum value of these random samples are limited in number.In order to solve the problem,we propose that exponential function be used to substitute the empirical cumulative distribution function(CDF) of the conventional Bootstrap method.Secondly the feasibility of the exponential function,Boltzmann function and three-cubed polynomial function modified by sample empirical CDF is studied.We conclude that the above problem can be solved by useing Boltzmann function and three-cubed polynomial function modified by sample empirical CDF so that the precision of estimation can be improved.Lastly,some examples are presented to illustrate the application of small scale sample test estimation method on the basis of the conventional Bootstrap method presented in the paper.
The Convergence Rates of the Weighted Bootstrap Distributions for Von Mises and U-Statistics

Shuran Zhao,Xingzhong Xu,Xiaobo Ding

DOI: https://doi.org/10.1080/10485250802280259

2008-01-01

Journal of Nonparametric Statistics

Abstract:It has been proved that the weighted bootstrap method for von Mises and U-statistics provides a feasible approximation to their sample distributions. In the paper, based on a variation of the Berry-Esseen theorem for U-statistics, we further develop such first-order convergence rate under weak conditions. Moreover, in view of maximum entropy, we provide a principle to choose the weights.
Strong uniform laws of large numbers for bootstrap means and other randomly weighted sums

Neil A. Spencer,Jeffrey W. Miller

2023-10-23

Abstract:This article establishes novel strong uniform laws of large numbers for randomly weighted sums such as bootstrap means. By leveraging recent advances, these results extend previous work in their general applicability to a wide range of weighting procedures and in their flexibility with respect to the effective bootstrap sample size. In addition to the standard multinomial bootstrap and the m-out-of-n bootstrap, our results apply to a large class of randomly weighted sums involving negatively orthant dependent (NOD) weights, including the Bayesian bootstrap, jackknife, resampling without replacement, simple random sampling with over-replacement, independent weights, and multivariate Gaussian weighting schemes. Weights are permitted to be non-identically distributed and possibly even negative. Our proof technique is based on extending a proof of the i.i.d. strong uniform law of large numbers to employ strong laws for randomly weighted sums; in particular, we exploit a recent Marcinkiewicz--Zygmund strong law for NOD weighted sums.

Probability,Statistics Theory
Weak convergence for random weighting estimation of smoothed quantile processes

Shesheng Gao,Yongmin Zhong,Chengfan Gu,Bijan Shirinzadeh

DOI: https://doi.org/10.1016/j.ins.2013.11.031

IF: 8.1

2014-01-01

Information Sciences

Abstract:This paper presents a new random weighting method for smoothed quantile processes. A theory is established for random weighting estimation of smoothed quantile processes. It proves the weak convergence of the random weighting estimation error. Experiments and comparison analysis demonstrate that the proposed random weighting method can effectively estimate statistics, and the achieved accuracy and convergence speed are much higher than those of the Bootstrap method.
APPROXIMATION TO THE DISTRIBUTION OF M-ESTIMATES IN RANKED-SET SAMPLING BY RANDOMLY WEIGHTED BOOTSTRAP

吴耀华,刘驰宇

DOI: https://doi.org/10.12341/jssms08409

2009-01-01

Abstract:Ranked-Set Sampling(RSS) is a sampling method when a set of sampling units drawn from the population can be ranked by certain means rather cheaply without the actual measurement of the variable of interest which is costly and/or time consuming.This paper is concerned with the consistency and asymptotic normality on the RSS M-estimates and approximation to its distribution by randomly weighted bootstrap.
Applying Random Weighting Method to Estimating NA Dependent Sample Mean

Huaxing Li,Shesheng Gao,Haiwei Wang

DOI: https://doi.org/10.3969/j.issn.1000-2758.2008.03.015

2008-01-01

Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University

Abstract:Aim. Ref.3 authored by Yu proposed the estimation of NA (negative association) dependent sample mean by using Bootstrap approximation method. Ref.4 authored by Zheng pointed out that Random weighting approximation is better than Bootstrap approximation. In the full paper, we explain in some detail how to apply random weighting approximation method to estimating NA dependent sample mean and then use a numerical example to show that random weighting approximation method is indeed better than Bootstrap approximation method. The first topic is: random weighting approximation method for estimating NA dependent sample mean and its consistency. In the first topic, we give a mathematical proof, including a theorem, for the consistency of the random weighting approximation. The second topic is: simulations results and their analysis. In this topic, we use the random weighting approximation method and the Bootstrap approximation method respectively to simulate the estimation of the data measured by two gyros. The simulation results, shown in Fig.1 and 2 in the full paper, indicate preliminarily that the estimation of the data with the random weighting method is highly accurate and indeed better than the Bootstrap approximation method.
Research of Reliability Assessment Based on Random Weighting Method

Sai Wu

2010-01-01

Abstract:The basic idea of random weighting method is introduced,and the method is used to evaluate the reliability parameters of small sample in normal distribution.By Monte Carlo simulation,the connection between accuracy and sample size is validated,and the applicable range is given.Results include that,for the confidence lower limit of sample mean,when the sample size is large enough,the accuracy can reach the request of the confidence.But for the confidence upper limit of sample variance,the accuracy is too low to accept,thus the method is inapplicability here.An example shows that,the random weighting method can get a more logical confidence lower limit of sample mean,and the advantage compared to the classical method is evidence.
Bootstrap LM Tests for Spatial Dependence in Panel Data Models with Fixed Effects

Bianling OU,Zhihe LONG,Wenqian LI

DOI: https://doi.org/10.21078/jssi-2019-330-14

2019-01-01

Journal of Systems Science and Information

Abstract:Abstract This paper applies bootstrap methods to LM tests (including LM-lag test and LM-error test) for spatial dependence in panel data models with fixed effects, and removes fixed effects based on orthogonal transformation method proposed by Lee and Yu (2010). The consistencies of LM tests and their bootstrap versions are proved, and then some asymptotic refinements of bootstrap LM tests are obtained. It shows that the convergence rate of bootstrap LM tests is O((NT)−2) and that of fast double bootstrap LM tests is O((NT)−5/2). Extensive Monte Carlo experiments suggest that, compared to aysmptotic LM tests, the size of bootstrap LM tests gets closer to the nominal level of signifiance, and the power of bootstrap LM tests is higher, especially in the cases with small spatial correlation. Moreover, when the error is not normal or with heteroskedastic, asymptotic LM tests suffer from severe size distortion, but the size of bootstrap LM tests is close to the nominal significance level. Bootstrap LM tests are superior to aysmptotic LM tests in terms of size and power.
Sharp variance estimator and causal bootstrap in stratified randomized experiments

Haoyang Yu,Ke Zhu,Hanzhong Liu

2024-06-26

Abstract:The design-based finite-population asymptotic theory provides a normal approximation for the sampling distribution of the average treatment effect estimator in stratified randomized experiments. The asymptotic variance could be estimated by a Neyman-type conservative variance estimator. However, the variance estimator can be overly conservative, and the asymptotic theory may fail in small samples. To solve these issues, we propose a sharp variance estimator for the weighted difference-in-means in stratified randomized experiments. Furthermore, we propose two causal bootstrap procedures to more accurately approximate the sampling distribution of the weighted difference-in-means estimator. The first causal bootstrap procedure is based on rank-preserving imputation and we prove its second-order refinement over normal approximation. The second causal bootstrap procedure is based on constant-treatment-effect imputation and is applicable in paired experiments. We prove its validity even when the assumption of constant treatment effect is violated for the true potential outcomes. Our analysis is randomization-based or design-based by conditioning on the potential outcomes, with treatment assignment being the sole source of randomness. Numerical studies and two real data applications demonstrate advantages of our proposed methods in finite samples.

Statistics Theory,Applications,Methodology
Consistency of the bootstrap for asymptotically linear estimators based on machine learning

Zhou Tang,Ted Westling

2024-04-18

Abstract:The bootstrap is a popular method of constructing confidence intervals due to its ease of use and broad applicability. Theoretical properties of bootstrap procedures have been established in a variety of settings. However, there is limited theoretical research on the use of the bootstrap in the context of estimation of a differentiable functional in a nonparametric or semiparametric model when nuisance functions are estimated using machine learning. In this article, we provide general conditions for consistency of the bootstrap in such scenarios. Our results cover a range of estimator constructions, nuisance estimation methods, bootstrap sampling distributions, and bootstrap confidence interval types. We provide refined results for the empirical bootstrap and smoothed bootstraps, and for one-step estimators, plug-in estimators, empirical mean plug-in estimators, and estimating equations-based estimators. We illustrate the use of our general results by demonstrating the asymptotic validity of bootstrap confidence intervals for the average density value and G-computed conditional mean parameters, and compare their performance in finite samples using numerical studies. Throughout, we emphasize whether and how the bootstrap can produce asymptotically valid confidence intervals when standard methods fail to do so.

Statistics Theory
Randomly weighted method in parameter estimation of generalized linear model

Yinglong GUO,Yaohua WU,Zhanfeng WANG

DOI: https://doi.org/10.3969/j.issn.0253-2778.2014.09.002

2014-01-01

Journal of University of Science and Technology of China

Abstract:In the generalized linear model , the randomly weighted method was applied to solve the asymptotic variance of parameter estimation .The asymptotic distribution of random weighted parameter estimation and unweighted parameter estimation were given by derivation ,and they were proven to be the same .So the easily acquired asymptotic distribution of the random weighted estimation could be used to approximate the asymptotic distribution of the original parameter estimation .
Random Weighting Estimation of Confidence Intervals for Quantiles

Shesheng Gao,Yongmin Zhong,Chengfan Gu

DOI: https://doi.org/10.1111/anzs.12018

2013-01-01

Australian & New Zealand Journal of Statistics

Abstract:SummaryThis paper presents a new random weighting method for confidence interval estimation for the sample ‐quantile. A theory is established to extend ordinary random weighting estimation from a non‐smoothed function to a smoothed function, such as a kernel function. Based on this theory, a confidence interval is derived using the concept of backward critical points. The resultant confidence interval has the same length as that derived by ordinary random weighting estimation, but is distribution‐free, and thus it is much more suitable for practical applications. Simulation results demonstrate that the proposed random weighting method has higher accuracy than the Bootstrap method for confidence interval estimation.

A Large Sample Study of Randomly Weighted Bootstrap in Linear Models

Asymptotic Efficiency of Randomly Weighted Bootstrap for Linear Models

Approximation to the Distribution of Least Distances Estimate in Multivariate Linear Models by Randomly Weighted Bootstrap

APPROXIMATING THE DISTRIBUTION OF M-ESTIMATORS IN LINEAR MODELS BY RANDOMLY WEIGHTED BOOTSTRAP

Approximation by Random Weighting Method for M-test in Linear Models

Wild bootstrap inference for penalized quantile regression for longitudinal data

Bootstrap Inference for Panel Data Quantile Regression

Approximation to the Distribution of the Least Squares Estimators in Two Dimensional Cosine Models by Randomly Weighted Bootstrap

Weighted Bootstrap Inference on Censored Regression Model

Study on Small Scale Sample Test Estimation Method Based on Bootstrap Method

The Convergence Rates of the Weighted Bootstrap Distributions for Von Mises and U-Statistics

Strong uniform laws of large numbers for bootstrap means and other randomly weighted sums

Weak convergence for random weighting estimation of smoothed quantile processes

APPROXIMATION TO THE DISTRIBUTION OF M-ESTIMATES IN RANKED-SET SAMPLING BY RANDOMLY WEIGHTED BOOTSTRAP

Applying Random Weighting Method to Estimating NA Dependent Sample Mean

Research of Reliability Assessment Based on Random Weighting Method

Bootstrap LM Tests for Spatial Dependence in Panel Data Models with Fixed Effects

Sharp variance estimator and causal bootstrap in stratified randomized experiments

Consistency of the bootstrap for asymptotically linear estimators based on machine learning

Randomly weighted method in parameter estimation of generalized linear model

Random Weighting Estimation of Confidence Intervals for Quantiles