Limiting Behavior of Recursive Algorithm for Estimates of Parameters in Single Index Models

戴静,缪柏其,金百锁

2009-01-01

Abstract:Single index model in semi-parametric statistics was studied,and the recursive algorithm(used in large samples) in single index model was analyzed.The strong consistency and the asymptotic normality of the estimators were established.Finally,the limiting behavior was proposed.

What problem does this paper attempt to address?

Limiting behavior of recursive M-estimators in multivariate linear regression models and their asymptotic efficiencies

Miao Baiqi,Wu Yuehua,Liu Donghai

DOI: https://doi.org/10.1016/S0252-9602(10)60048-3

2010-01-01

Acta Mathematica Scientia

Abstract:Recursive algorithms are very useful for computing M-estimators of regression coefficients and scatter parameters. In this article, it is shown that for a nondecreasing u1(t), under some mild conditions the recursive M-estimators of regression coefficients and scatter parameters are strongly consistent and the recursive M-estimator of the regression coefficients is also asymptotically normal distributed. Furthermore, optimal recursive M-estimators, asymptotic efficiencies of recursive M-estimators and asymptotic relative efficiencies between recursive M-estimators of regression coefficients are studied.
Limiting Behavior of RecursiveM-Estimators in Multivariate Linear Regression Models

B.Q. Miao,Y. Wu

DOI: https://doi.org/10.1006/jmva.1996.0054

IF: 1.387

1996-01-01

Journal of Multivariate Analysis

Abstract:In this paper, several recursive algorithms for computingM-estimates in multivariate linear regression models are discussed. It is shown that the recursiveM-estimators of regression coefficient and scatter parameters are strongly consistent. In particular, the asymptotic normality of the recursiveM-estimators of regression coefficients is established.
Asymptotic Normality of the Recursive M-estimators of the Scale Parameters

Baiqi Miao,Yuehua Wu,Donghai Liu,Qian Tong

DOI: https://doi.org/10.1007/s10463-006-0051-y

2006-01-01

Annals of the Institute of Statistical Mathematics

Abstract:In this paper, the limit distributions of the recursive M-estimators of scatter parameters in a multivariate linear model setting are studied. Under some mild conditions, the asymptotic normality of the recursive M-esimtators is established. Some Monte Carlo simulation results are presented to illustrate the performance of the recursive M-estimators.
Improve recursive identification using multi-iteration

Xiangping Zhang,Yucai Zhu,Paul P J Van Den Bosch

DOI: https://doi.org/10.3182/20090706-3-FR-2004.00073

2009-01-01

IFAC Proceedings Volumes

Abstract:A multi-iteration recursive identification algorithm is proposed and studied. The algorithm performs multiple iterations for each data sample in order to improve the accuracy of the estimate. The algorithm is worked out for an ARMAX model using Gauss Newton method and pseudo-linear regression. The convergence of the methods is proved by using stochastic process theory and martingale convergence technique. Simulation results show that the algorithm has higher accuracy in parameter estimation and faster convergence than the conventional recursive method.
Recursive estimation in large panel data models: Theory and practice

Bin Jiang,Yanrong Yang,Jiti Gao,Cheng Hsiao

DOI: https://doi.org/10.1016/j.jeconom.2020.07.055

IF: 3.363

2021-10-01

Journal of Econometrics

Abstract:<p>Bai (2009) proposes recursive estimation for panel data models with interactive effects. We study the behaviours of this recursive estimator. The recursive formula is established that shows the behaviours of recursive estimators depend on the initial estimator, the population structure and the iterative steps. Under some general scenarios, we find that the recursive estimator becomes consistent after the first iteration from any initials. We also obtain the optimal number of iterative steps under some prescribed conditions. The central limit theorem of the recursive estimator is established when the initial estimator is OLS. Various simulations are conducted to support our theoretical findings.</p>

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications
Estimator of a Change Point in Single Index Models

BaiSuo Jin,CuiLing Dong,ChangChun Tan,BaiQi Miao

DOI: https://doi.org/10.1007/s11425-014-4820-4

2014-01-01

Science China Mathematics

Abstract:This paper considers the problem of change point in single index models. In order to obtain asymptotically valid confidence intervals for the estimation of the change point, the convergence rate and asymptotic distribution of the change point estimate is studied. Some simulation results are presented which show that the numerical performance of our estimator is satisfactory.
Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Li-Xin Zhang

DOI: https://doi.org/10.1214/16-aap1187

2016-01-01

The Annals of Applied Probability

Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).
Estimation of Single-index Models with Fixed Censored Responses

Hailin Huang,Yuanzhang Li,Hua Liang,Yanlin Tang

DOI: https://doi.org/10.5705/ss.202017.0451

IF: 1.4

2018-01-01

Statistica Sinica

Abstract:We propose a new procedure to estimate the index parameter and link function of single-index models, where the response variable is subject to fixed censoring. Under some regularity conditions, we show that the estimated index parameter is root-n consistent and asymptotically normal, and the estimated nonparametric link function achieves the optimal convergence rate and is asymptotically normal. In addition, we propose a linearity testing method for the nonparametric link function. A simulation study shows that the proposed procedures perform well in finite-sample experiments. An application to an HIV data set is presented for illustrative purposes.
Strong Converge of the Recursive M-estimation when Explanatory Variables Are Design Matrices

LIU Dong-hai,MIAO Bai-qi

DOI: https://doi.org/10.3969/j.issn.0253-2778.2006.09.007

2006-01-01

JUSTC

Abstract:The recursive M-estimation algorithm was studied when the explanatory variables were design matrices.Based on some common ideas,the recursive algorithm was proposed and its strong converge was proved.
Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

Yue Wang,Xiaohui Yuan,Chunjie Wang

DOI: https://doi.org/10.1080/03610926.2023.2198625

2024-01-01

Abstract:This article investigates the estimation and variable selection procedures of single-index models when the data have non ignorable response. For estimation of the index coefficients, a new procedure based on martingale difference divergence is developed. Consistency and asymptotic normality of the proposed estimators are established. The finite sample performance of the proposed procedure is assessed through extensive simulation studies. Finally, we illustrate the proposed method through a real body fat data set.
ASYMPTOTIC DISTRIBUTIONS FOR TWO ESTIMATORS OF THE SINGLE-INDEX MODEL

Yingcun Xia

DOI: https://doi.org/10.1017/s0266466606060531

IF: 1.968

2006-01-01

Econometric Theory

Abstract:The single-index model is one of the most popular semiparametric models in applied quantitative sciences. Two new estimation methods have been proposed recently by Hristache, Juditski, and Spokoiny (2001, Annals of Statistics 29, 595–623) and Xia, Tong, Li, and Zhu (2002, Journal of the Royal Statistical Society, Series B 64, 363–410), respectively. However, their asymptotic distributions have not been investigated yet. In this paper, alternative versions for the methods are investigated. Asymptotic distributions of the estimators are derived. Efficiency comparisons between the estimation methods are made.The author is most grateful to Professor O. Linton and Professor W. Härdle for helpful discussions. Valuable comments from two anonymous reviewers have improved the presentation of the paper substantially. The research has been partially supported by NUS research grant R-155-000-048-112, National University of Singapore, Singapore, and the Alexander von Humboldt Foundation, Germany.
Selecting an Adaptive Sequence for Computing Recursive M-estimators in Multivariate Linear Regression Models

Baiqi Miao,Qian Tong,Yuehua Wu,Baisuo Jin

DOI: https://doi.org/10.1007/s11424-013-1113-x

2013-01-01

Abstract:In this paper, the authors consider an adaptive recursive algorithm by selecting an adaptive sequence for computing M-estimators in multivariate linear regression models. Its asymptotic property is investigated. The recursive algorithm given by Miao and Wu (1996) is modified accordingly. Simulation studies of the algorithm is also provided. In addition, the Newton-Raphson iterative algorithm is considered for the purpose of comparison.
Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

Chaohua Dong,Yundong Tu

DOI: https://doi.org/10.1017/s0266466624000021

IF: 1.968

2024-02-10

Econometric Theory

Abstract:This paper considers semiparametric sieve estimation in high-dimensional single index models. The use of Hermite polynomials in approximating the unknown link function provides a convenient framework to conduct both estimation and variable selection. The estimation of the index parameter is formulated from solutions obtained by the routine penalized weighted linear regression procedure, where the weights are used in order to tackle the unbounded support of the regressors. The resulting index parameter estimator is shown to be consistent and sparse, and the asymptotic normality for the estimators of both the index parameter and the link function is established. To perform variable selection in the ultra-high dimension case, we further suggest a forward regression screening method, which is shown to enjoy the sure independence screening property. This screening procedure can be used before the penalized variable selection to reduce the burden of dimensionality. Numerical results show that both the variable selection procedures and the associated estimators perform well in finite samples.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Semiparametric Models with Single-Index Nuisance Parameters

Kyungchul Song

DOI: https://doi.org/10.48550/arXiv.1307.5806

2013-07-23

Abstract:In many semiparametric models, the parameter of interest is identified through conditional expectations, where the conditioning variable involves a single-index that is estimated in the first step. Among the examples are sample selection models and propensity score matching estimators. When the first-step estimator follows cube-root asymptotics, no method of analyzing the asymptotic variance of the second step estimator exists in the literature. This paper provides nontrivial sufficient conditions under which the asymptotic variance is not affected by the first step single index estimator regardless of whether it is root-n or cube-root consistent. The finding opens a way to simple inference procedures in these models. Results from Monte Carlo simulations show that the procedures perform well in finite samples.

Methodology
Semiparametric inference for the recurrent event process by means of a single-index model

Olivier Bouaziz,Ségolen Geffray,Olivier Lopez

DOI: https://doi.org/10.48550/arXiv.1005.4553

2010-05-25

Statistics Theory

Abstract:In this paper, we introduce new parametric and semiparametric regression techniques for a recurrent event process subject to random right censoring. We develop models for the cumula- tive mean function and provide asymptotically normal estimators. Our semiparametric model which relies on a single-index assumption can be seen as a dimension reduction technique that, contrary to a fully nonparametric approach, is not stroke by the curse of dimensional- ity when the number of covariates is high. We discuss data-driven techniques to choose the parameters involved in the estimation procedures and provide a simulation study to support our theoretical results.
Estimation for Biased Partial Linear Single Index Models

Jun Lu,Xuehu Zhu,Lu Lin,Lixing Zhu

DOI: https://doi.org/10.1016/j.csda.2019.03.006

IF: 2.035

2019-01-01

Computational Statistics & Data Analysis

Abstract:In this paper, we propose a novel method to consistently estimate, at the root-n rate, the coefficient parameters in a biased partial linear single-index model whose error term does not have zero conditional expectation. To achieve this purpose, we first transfer the model to a pro forma linear model and then introduce an artificial variable into a linear bias correction model. Based on the bias correction model, the parameters can then be consistently estimated by the linear least squares method. Both numerical studies and real data analyses are conducted to show the effectiveness of the proposed estimation procedure.
SEMIPARAMETRIC ESTIMATION OF CONDITIONAL HETEROSCEDASTICITY VIA SINGLE-INDEX MODELING.

Liping Zhu,Yuexiao Dong,Runze Li

DOI: https://doi.org/10.5705/ss.2012.075

IF: 1.4

2012-01-01

Statistica Sinica

Abstract:We consider a single-index structure to study heteroscedasticity in regression with high-dimensional predictors. A general class of estimating equations is introduced, the resulting estimators remain consistent even when the structure of the variance function is misspecified. The proposed estimators also possess an adaptive property in an asymptotic sense. That is, they estimate the conditional variance function asymptotically as well as if the conditional mean function was given a priori. Numerical studies confirm our theoretical observations and demonstrate that our proposed estimator is superior to existing estimators with less bias and smaller standard deviation.
Semiparametric Jump-Preserving Estimation for Single-Index Models

Guoxiang Liu,Xiuli Du,Mengmeng Wang,Jinguan Lin,Qibing Gao

DOI: https://doi.org/10.1080/10485252.2018.1444164

2018-01-01

Journal of Nonparametric Statistics

Abstract:Estimation of the single-index model with a discontinuous unknown link function is considered in this paper. Existed refined minimum average variance estimation (rMAVE) method can estimate the single-index parameter and unknown link function simultaneously by minimising the average pointwise conditional variance, where the conditional variance can be estimated using the local linear fit method with centred kernel function. When there are jumps in the link function, big biases around jumps can appear. For this reason, we embed the jump-preserving technique in the rMAVE method, then propose an adaptive jump-preserving estimation procedure for the single-index model. Concretely speaking, the conditional variance is obtained by the one among local linear fits with centred, left-sided and right-sided kernel functions who has minimum weighted residual mean squares. The resulting estimators can preserve the jumps well and also give smooth estimates of the continuity parts. Asymptotic properties are established under some mild conditions. Simulations and real data analysis show the proposed method works well.
On Estimation of the Variances for Critical Branching Processes with Immigration

Chunhua Ma,Longmin Wang

DOI: https://doi.org/10.1017/s0021900200006793

IF: 1.1161

2010-01-01

Journal of Applied Probability

Abstract:The conditional least-squares estimators of the variances are studied for a critical branching process with immigration that allows the offspring distributions to have infinite fourth moments. We derive different forms of limiting distributions for these estimators when the offspring distributions have regularly varying tails with index α. In particular, in the case in which 2 < α < 8/3, the normalizing factor of the estimator for the offspring variance is smaller than √ n , which is different from that of Winnicki (1991).
Estimation for a Partial-Linear Single-Index Model

Tingting Li,Hu Yang,Jane-Ling Wang,Liugen Xue,Li Zhu

DOI: https://doi.org/10.1214/11-aos953

2011-01-01

The Annals of Statistics

Abstract:This note is to correct an error in Lemma A.7 of Wang et al. (2010).The original claim of asymptotically higher efficiency no longer holds.

Limiting Behavior of Recursive Algorithm for Estimates of Parameters in Single Index Models

Limiting behavior of recursive M-estimators in multivariate linear regression models and their asymptotic efficiencies

Limiting Behavior of RecursiveM-Estimators in Multivariate Linear Regression Models

Asymptotic Normality of the Recursive M-estimators of the Scale Parameters

Improve recursive identification using multi-iteration

Recursive estimation in large panel data models: Theory and practice

Estimator of a Change Point in Single Index Models

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Estimation of Single-index Models with Fixed Censored Responses

Strong Converge of the Recursive M-estimation when Explanatory Variables Are Design Matrices

Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

ASYMPTOTIC DISTRIBUTIONS FOR TWO ESTIMATORS OF THE SINGLE-INDEX MODEL

Selecting an Adaptive Sequence for Computing Recursive M-estimators in Multivariate Linear Regression Models

Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

Semiparametric Models with Single-Index Nuisance Parameters

Semiparametric inference for the recurrent event process by means of a single-index model

Estimation for Biased Partial Linear Single Index Models

SEMIPARAMETRIC ESTIMATION OF CONDITIONAL HETEROSCEDASTICITY VIA SINGLE-INDEX MODELING.

Semiparametric Jump-Preserving Estimation for Single-Index Models

On Estimation of the Variances for Critical Branching Processes with Immigration

Estimation for a Partial-Linear Single-Index Model