Abstract:We propose a robust estimation procedure based on local Walsh-average regression (LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions; the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency (ARE) has a lower bound compared with the least squares (LS) estimates; the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty; this procedure is shown to possess the oracle property. We also propose a Bayes information criterion (BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.

A Lasso-Type Approach for Estimation and Variable Selection in Single Index Models

Penalized Least Squares for Single Index Models

Penalized LAD regression for single index models

Robust Variable Selection Based on Penalized Composite Quantile Regression for High-Dimensional Single-Index Models

Variable Selection for the Partial Linear Single-Index Model

The adaptive L1-penalized LAD regression for partially linear single-index models

Local Walsh-average-based Estimation and Variable Selection for Single-Index Models

BS-SIM: An effective variable selection method for high-dimensional single index model

New Efficient Estimation and Variable Selection in Models with Single-Index Structure

A robust and efficient estimation and variable selection method for partially linear single-index models.

Variable selection and estimation for semi-parametric multiple-index models

Variable Selection in a Class of Single-Index Models

Variable Selection and Estimation for Partially Linear Single-index Models with Longitudinal Data

Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

Simultaneous Estimation and Variable Selection in Median Regression Using Lasso-type Penalty

Variable Selection for Single-Index Models Based on Martingale Difference Divergence

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

Estimation and Variable Selection in Partial Linear Single Index Models with Error-Prone Linear Covariates

Variable selection for partially linear single-index varying-coefficient model

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Quantile Regression and Variable Selection for Single-Index Varying-Coefficient Models