Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Generalized Regression Estimators with High-Dimensional Covariates

Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Robust Variable Selection for Generalized Linear Models with A Diverging Number of Parameters

Adaptive Lasso for generalized linear models with a diverging number of parameters

Robust Estimation for Partially Linear Models with Large-Dimensional Covariates

Empirical Likelihood-Based Estimation and Inference in Randomized Controlled Trials with High-Dimensional Covariates

Homogeneity Estimation in Multivariate Generalized Linear Models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics

Variable Selection in High-Dimensional Double Generalized Linear Models

One-Step Regularized Estimator for High-Dimensional Regression Models

Communication-efficient distributed estimator for generalized linear models with a diverging number of covariates

Estimation and inference in generalized additive coefficient models for nonlinear interactions with high-dimensional covariates

Variable Selection for Generalized Linear Model with Highly Correlated Covariates

Combined-Penalized Likelihood Estimations with A Diverging Number of Parameters

Geographically Weighted Regression Model-Assisted Estimation in Survey Sampling

NONCONCAVE PENALIZED M-ESTIMATION WITH A DIVERGING NUMBER OF PARAMETERS

Generalised Regression Estimators for Average Treatment Effect with Multicollinearity in High-Dimensional Covariates

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Robust Approach for Variable Selection with High Dimensional Longitudinal Data Analysis