Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

A KERNEL-BASED METHOD FOR ESTIMATING ADDITIVE PARTIALLY LINEAR MODELS

Efficient Estimation of Additive Partially Linear Models

A robust and efficient estimation and variable selection method for partially linear single-index models.

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Statistical Inference on Semi-Parametric Partial Linear Additive Models

Kernel-based Estimation for Partially Functional Linear Model: Minimax Rates and Randomized Sketches

Communication-efficient Distributed Estimation of Partially Linear Additive Models for Large-Scale Data

Empirical-Likelihood-Based Inference for Partially Linear Models

Estimation of a Semiparametric Varying-Coefficient Partially Linear Errors-in-variables Model

Statistical inference in the partial linear models with the inverse gaussian kernel

Spline-Backfitted Kernel Smoothing of Partially Linear Additive Model

Principal Components Regression Estimation in Semiparametric Partially Linear Additive Models

An Adaptive Two-stage Estimation Method for Additive Models

An Efficient Estimation for the Parameter in Additive Partially Linear Models with Missing Covariates

Efficient Estimation of Generalized Additive Partially Linear Model

M-Estimation on Partially Linear Models

Statistical Inference on Partially Linear Additive Models with Missing Response Variables and Error-Prone Covariates

Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Monotone Function Estimation in Partially Linear Models

Adaptive Bayesian nonparametric regression using kernel mixture of polynomials with application to partial linear model

Stochastic Restricted Estimation in Partially Linear Additive Errors-in-variables Models