Abstract:We propose a robust estimation procedure based on local Walsh-average regression (LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions; the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency (ARE) has a lower bound compared with the least squares (LS) estimates; the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty; this procedure is shown to possess the oracle property. We also propose a Bayes information criterion (BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.

Local Rank Estimation and Related Test for Varying-Coefficient Partially Linear Models

Two-stage Local Rank Estimation for Generalised Partially Linear Varying-Coefficient Models

Statistical inference in partially time-varying coefficient models

Varying Coefficient Partially Nonlinear Models with Nonstationary Regressors

Local Linear M‐estimation in Non‐parametric Spatial Regression

Robust Adaptive Model Selection and Estimation for Partial Linear Varying Coefficient Models in Rank Regression

Estimation and Inference for Varying Coefficient Partially Nonlinear Errors-in-variables Models.

Estimation and Inference for Varying Coefficient Partially Nonlinear Models

Estimation of a Semiparametric Varying-Coefficient Partially Linear Errors-in-variables Model

Local Constant Kernel Estimation of a Partially Linear Varying Coefficient Cointegration Model

A robust and efficient estimation and variable selection method for partially linear single-index models.

Rank-Based Test for Partial Functional Linear Regression Models

Statistical inference on seemingly unrelated varying coefficient partially linear models

Statistical inference for semiparametric varying-coefficient partially linear models with error-prone linear covariates

Efficient Inference about the Partially Linear Varying Coefficient Model with Random Effect for Longitudinal Data.

Partially functional linear varying coefficient model

Bias-corrected Estimations in Varying-Coefficient Partially Nonlinear Models with Measurement Error in the Nonparametric Part

Rank method for partial functional linear regression models

Local Walsh-average-based Estimation and Variable Selection for Single-Index Models

Quantile Regression in Partially Linear Varying Coefficient Models

Testing the Constancy in Varying-Coefficient Regression Models