Abstract:We propose a robust estimation procedure based on local Walsh-average regression (LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions; the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency (ARE) has a lower bound compared with the least squares (LS) estimates; the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty; this procedure is shown to possess the oracle property. We also propose a Bayes information criterion (BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.

Walsh-average Based Variable Selection for Varying Coefficient Models

Local Walsh-average-based Estimation and Variable Selection for Single-Index Models

Regularization and variable selection for infinite variance autoregressive models

Variable Selection for Varying Coefficient Models Via Kernel Based Regularized Rank Regression

Shrinkage Estimation of the Varying Coefficient Model

Local Walsh-average-based Estimation and Variable Selection for Spatial Single-index Autoregressive Models

Robust Structure Identification and Variable Selection in Partial Linear Varying Coefficient Models

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Robust variable selection for the varying index coefficient models

A Unified Variable Selection Approach for Varying Coefficient Models

A New Variable Selection Approach for Varying Coefficient Models

WLAD-LASSO Method for Robust Estimation and Variable Selection in Partially Linear Models

Robust Check Loss-Based Variable Selection of High-Dimensional Single-Index Varying-Coefficient Model.

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Variable Selection for Varying Coefficient Models with Measurement Errors

Robust Variable Selection and Parametric Component Identification in Varying Coefficient Models

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Variable Selection in Rank Regression for Analyzing Longitudinal Data

Robust Variable Selection in Modal Varying-Coefficient Models with Longitudinal

Robust Adaptive Model Selection and Estimation for Partial Linear Varying Coefficient Models in Rank Regression