Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Simultaneous sparse model selection and coefficient estimation for heavy-tailed autoregressive processes

Regularization and variable selection for infinite variance autoregressive models

Poisson Autoregressive Process Modeling Via the Penalized Conditional Maximum Likelihood Procedure

Exponential Squared Loss Based Robust Variable Selection of AR Models

Adaptive lasso variable selection method for semiparametric spatial autoregressive panel data model with random effects

Variable Selection for the Partial Linear Single-Index Model

Variable Selection for an Improved INAR(1) Model with Explanatory Variables Using 2SPCLS

On Sparse Estimation for Semiparametric Linear Transformation Models

A robust and efficient estimation and variable selection method for partially linear single-index models.

Consistent Model Selection Procedure for Random Coefficient INAR Models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Penalised inference for autoregressive moving average models with time-dependent predictors

Variable selection for partially linear single-index varying-coefficient model

Variable Selection Using Penalized Empirical Likelihood

Robust Variable Selection in Partially Varying Coefficient Single-Index Model

Model Estimation and Selection for Partial Linear Varying Coefficient EV Models with Longitudinal Data.

Oracally Efficient Estimation and Consistent Model Selection for Auto-Regressive Moving Average Time Series with Trend

Automatic variable selection for semiparametric spatial autoregressive model

Subset Selection for Vector Autoregressive Processes Via Adaptive Lasso

Adaptive lasso variable selection for the accelerated failure models

Robust Variable Selection with Exponential Squared Loss for the Spatial Autoregressive Model