Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Strong convergence rates of several estimators in semiparametric varying-coefficient partially linear models

Varying Coefficient Partially Nonlinear Models with Nonstationary Regressors

Variable selection in partially time-varying coefficient models

Asymptotic Efficient Estimation in Semiparametric Nonlinear Regression Models

Efficient estimation of partially linear varying coefficient models

Strong convergence rate of estimators of change point and its application

ESTIMATION IN A SEMIPARAMETRIC MONOTONE VARYING COEFFICIENT PARTIALLY LINEAR MODEL WITH ERRORS IN VARIABLES

Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Weighted Profile Least Squares Estimation for a Panel Data Varying-Coefficient Partially Linear Model

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

The rates of strong consistency for estimators in heteroscedastic partially linear errors-in-variables model for widely orthant dependent samples

Strong convergence rate of the least median absolute estimator in linear regression models

On Sparse Estimation for Semiparametric Linear Transformation Models

Efficient Estimation for Semivarying-Coefficient Models

Convergence of the CUSUM estimation for a mean shift in linear processes with random coefficients

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

Semiparametric efficient estimation in high‐dimensional partial linear regression models

A Unified Variable Selection Approach for Varying Coefficient Models

Profile Likelihood Estimation of Partially Linear Panel Data Models with Fixed Effects