Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Optimal difference-based estimation for partially linear models

Variable selection in partially time-varying coefficient models

Optimal-$k$ Difference Sequence in Nonparametric Regression

On the Choice of Difference Sequence in a Unified Framework for Variance Estimation in Nonparametric Regression

Comparison of Difference Based Variance Estimators for Partially Linear Models

On Difference‐based Gradient Estimation in Nonparametric Regression

Difference-based variance estimation in nonparametric regression with repeated measurement data

A robust and efficient estimation and variable selection method for partially linear single-index models.

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Difference-based estimation for error variances in repeated measurement regression models

Optimal Difference-based Variance Estimators in Time Series: A General Framework

Efficient estimation of partially linear varying coefficient models

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Estimation and variable selection for partial functional linear regression

Optimal Estimation of Derivatives in Nonparametric Regression

Statistical Inference for Partially Linear Regression Models with Measurement Errors

Difference-based covariance matrix estimation in time series nonparametric regression with application to specification tests

Difference-based covariance matrix estimate in time series nonparametric regression with applications to specification tests

Statistical inference for semiparametric varying-coefficient partially linear models with error-prone linear covariates

Empirical-Likelihood-Based Inference for Partially Linear Models

Variable selection in partially linear additive models for modal regression.