Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Variance estimation for sparse ultra-high dimensional varying coefficient models

Spline estimator for ultra-high dimensional partially linear varying coefficient models

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Shrinkage Estimation of the Varying Coefficient Model

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Efficient estimation of partially linear varying coefficient models

Forward Variable Selection for Sparse Ultra-High Dimensional Varying Coefficient Models

Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data

Sparse factor models of high dimension

Variance function estimation in high-dimensions

Sparsified simultaneous confidence intervals for high-dimensional linear models

Generalized varying coefficient partially linear measurement errors models

Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models

Variable Selection for the Partial Linear Single-Index Model

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models

Variable selection for semiparametric varying-coefficient spatial autoregressive models with a diverging number of parameters

Spline-based sieve estimation in monotone constrained varying-coefficient partially linear EV model

Penalized Sparse Covariance Regression with High Dimensional Covariates

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates