Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

Asymptotic expansion for nonparametric M-estimator in a nonlinear regression model with long-memory errors

MORE EFFICIENT ESTIMATION IN NONPARAMETRIC REGRESSION WITH NONPARAMETRIC AUTOCORRELATED ERRORS

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

On Estimating the Nonparametric Multiplicative Error Models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

More Efficient Estimation of Nonparametric Panel Data Models with Random Effects

Efficiency of a Stochastic Restricted Two-Parameter Estimator in Linear Regression

A robust and efficient estimation and variable selection method for partially linear single-index models.

A Generalized Semiparametric Regression and Its Efficient Estimation

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Sparse Semiparametric Efficient Estimation in High-Dimensional Linear Regression Models

Efficient Estimation of Non Parametric Simultaneous Equations Models

Efficient Estimation of Seemingly Unrelated Additive Nonparametric Regression Models.

Higher Order Mean Squared Error of Generalized Method of Moments Estimators for Nonlinear Models

Asymptotics of Estimators for Nonparametric Multivariate Regression Models with Long Memory

Covariance-Improved Estimator of.Generalized Seemingly Unrelated Regression Equations System

Generalized Resubstitution for Regression Error Estimation

Analysis of Longitudinal Data with Semiparametric Estimation of Covariance Function.

Two-Stage Efficient Estimation of Longitudinal Nonparametric Additive Models

Stable and bias-corrected estimation for nonparametric regression models