Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

WLAD-LASSO Method for Robust Estimation and Variable Selection in Partially Linear Models

Weighted LAD-LASSO method for robust parameter estimation and variable selection in regression

Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso

Variable Selection for Partially Linear Models via Adaptive LASSO

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

Robust Variable Selection Based on Relaxed Lad Lasso

The adaptive L1-penalized LAD regression for partially linear single-index models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

A robust and efficient estimation and variable selection method for partially linear single-index models.

Robust Estimation and Variable Selection in Censored Partially Linear Additive Models

Fused LASSO Penalized Least Absolute Deviation Estimator for High Dimensional Linear Regression

Model selection via standard error adjusted adaptive lasso

The Linearized Alternating Direction Method of Multipliers for Sparse Group LAD Model.

New Robust Variable Selection Methods for Linear Regression Models

Robust Structure Identification and Variable Selection in Partial Linear Varying Coefficient Models

Robust Shrinkage Estimation and Selection for Functional Multiple Linear Model Through LAD Loss

Penalized Empirical Likelihood for Partially Linear Errors-in-variables Models

Robust Adaptive Model Selection and Estimation for Partial Linear Varying Coefficient Models in Rank Regression

Regression Coefficient and Autoregressive Order Shrinkage and Selection Via the Lasso

SCAD-Penalized Least Absolute Deviation Regression in High-Dimensional Models

Robust variable selection for partially linear additive models