Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

Statistical inference on seemingly unrelated non-parametric regression models with serially correlated errors

Seemingly unrelated nonparametric models with positive correlation and constrained error variances

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

MORE EFFICIENT ESTIMATION IN NONPARAMETRIC REGRESSION WITH NONPARAMETRIC AUTOCORRELATED ERRORS

Nonparametric and Semiparametric Panel Econometric Models: Estimation and Testing

Efficient Estimation in Varying Coefficient Panel Data Model with Different Smoothing Variables and Fixed Effects

Estimation of fixed effects semiparametric single-index panel model with spatio-temporal correlated errors

Weighted Profile Least Squares Estimation for a Panel Data Varying-Coefficient Partially Linear Model

Efficient Estimation of Non Parametric Simultaneous Equations Models

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Robust estimation in a nonlinear cointegration model

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

More Efficient Estimation of Nonparametric Panel Data Models with Random Effects

Local Polynomial Estimation of Nonparametric Simultaneous Equations Models

Nonparametric dynamic panel data models: Kernel estimation and specification testing

Robust estimation of panel data regression models and applications

Statistical Inference of Seemingly Unrelated Partially Linear Additive Regression Models

On Estimating the Nonparametric Multiplicative Error Models

Semiparametric Mixture Regression with Unspecified Error Distributions

A robust estimation based on penalised regularisation for the varying-coefficient additive model