Abstract:We propose a robust estimation procedure based on local Walsh-average regression (LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions; the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency (ARE) has a lower bound compared with the least squares (LS) estimates; the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty; this procedure is shown to possess the oracle property. We also propose a Bayes information criterion (BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.

Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

Estimation in a Partially Linear Single-Index Model with Missing Response Variables and Error-Prone Covariates

Variable Selection for Single-Index Models Based on Martingale Difference Divergence

Estimation And Empirical Likelihood For Single-Index Models With Missing Data In The Covariates

Inverse Probability Weighted Estimators for Single-Index Models with Missing Covariates

A Lasso-Type Approach for Estimation and Variable Selection in Single Index Models

Single-index Varying-Coefficient Models with Missing Covariates at Random.

Multi-index Regression Models with Missing Covariates at Random

Penalized Least Squares for Single Index Models

Variable Selection and Estimation for Partially Linear Single-index Models with Longitudinal Data

New Efficient Estimation and Variable Selection in Models with Single-Index Structure

Robust Variable Selection for Single-Index Varying-Coefficient Model with Missing Data in Covariates

Quantile Regression and Variable Selection for Single-Index Varying-Coefficient Models

Estimation of single index model with missing response at random

A new variable selection and estimation algorithm for the high-dimensional quantile single-index model

Efficient Estimation in Heteroscedastic Single-Index Models

Variable Selection in a Class of Single-Index Models

Variable selection and estimation for semi-parametric multiple-index models

Local Walsh-average-based Estimation and Variable Selection for Single-Index Models

Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

Estimation for Single-Index mixed models with Longitudinal data