Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Robust group non-convex estimations for high-dimensional partially linear models

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Robust estimation of the generalised partial linear model with missing covariates

Adaptive group bridge estimation for high-dimensional partially linear models

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Robust Estimation in Partial Linear Mixed Model for Longitudinal Data

A High-dimensional M-estimator Framework for Bi-level Variable Selection

Consistent group selection in high-dimensional linear regression

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Robust estimation of covariance parameters in partial linear model for longitudinal data☆

Unified robust estimation

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

ROBUST SUBGROUP IDENTIFICATION

Robust Estimation in Generalized Semiparametric Mixed Models for Longitudinal Data

Robust Estimation for Function-on-scalar Regression Models

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Robust variable selection for partially linear additive models

Group Regularized Estimation under Structural Hierarchy