Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Estimation and variable selection for partial functional linear regression

Variable selection in partially time-varying coefficient models

Estimation and Variable Selection for Partially Functional Linear Models

Partial functional linear quantile regression

Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models

Variable Selection for Partially Linear Models via Adaptive LASSO

Estimation and Variable Selection in Generalized Partially Nonlinear Models with Nonignorable Missing Responses

Estimation in Partially Observed Functional Linear Quantile Regression

A robust and efficient estimation and variable selection method for partially linear single-index models.

Variable Selection in the Partially Linear Errors-in-variables Models for Longitudinal Data

Statistical Inference in the Partial Functional Linear Expectile Regression Model

Estimation and inference for functional linear regression models with partially varying regression coefficients

Estimation and Variable Selection for Generalized Functional Partially Varying Coefficient Hybrid Models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Variable Selection for Partially Linear Models with Randomly Censored Data

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Robust Estimation for Partial Functional Linear Regression Model Based on Modal Regression

Variable Selection and Estimation for Partially Linear Single-index Models with Longitudinal Data

Double Penalized Variable Selection Procedure for Partially Linear Models with Longitudinal Data

Statistical Inference for Partially Linear Regression Models with Measurement Errors

Quantile regression for robust estimation and variable selection in partially linear varying-coefficient models