Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Estimation and inference in generalized additive coefficient models for nonlinear interactions with high-dimensional covariates

Model Estimation and Selection for Partial Linear Varying Coefficient EV Models with Longitudinal Data.

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Generalized Partial Linear Models with Nonignorable Dropouts

Generalized Regression Estimators with High-Dimensional Covariates

Shrinkage Estimation Analysis of Correlated Binary Data with a Diverging Number of Parameters

Variable Selection for Generalized Linear Model with Highly Correlated Covariates

Estimation and Variable Selection for Generalized Functional Partially Varying Coefficient Hybrid Models

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Communication-efficient Distributed Estimation of Partially Linear Additive Models for Large-Scale Data

Polynomial Spline Estimation for Generalized Varying Coefficient Partially Linear Models with a Diverging Number of Components

Combined-Penalized Likelihood Estimations with A Diverging Number of Parameters

Variable Selection for Generalized Partially Linear Models with Longitudinal Data.

Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Robust Estimation for Partially Linear Models with Large-Dimensional Covariates

A robust and efficient estimation and variable selection method for partially linear single-index models.

Statistical Inference on Semi-Parametric Partial Linear Additive Models