Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

A Robust Penalized Estimation for Identification in Semiparametric Additive Models

A robust estimation based on penalised regularisation for the varying-coefficient additive model

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Estimation of Semi-Parametric Additive Coefficient Model

Identification of partially linear structure in additive models with an application to gene expression prediction from sequences

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Solving Euler equations via two-stage nonparametric penalized splines

Globally consistent model selection in semi-parametric additive coefficient models

Efficient penalized estimating method in the partially varying-coefficient single-index model

Two-step estimation of high dimensional additive models

Robust variable selection for partially linear additive models

Efficient estimation of a linear transformation model for current status data via penalized splines

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Variable Selection for Additive Model Via Cumulative Ratios of Empirical Strengths Total

Simultaneous variable selection and estimation in semiparametric regression of mixed panel count data

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

Efficient Estimation of COM-Poisson Regression and a Generalized Additive Model