Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Tail Index Varying Coefficient Model

Robust variable selection for the varying index coefficient models

A robust estimation based on penalised regularisation for the varying-coefficient additive model

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

Robust MAVE for single-index varying-coefficient models

Large Dimensional Time-Varying GMM Estimation: A New Approach

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Efficient penalized estimating method in the partially varying-coefficient single-index model

Penalized robust estimators in logistic regression with applications to sparse models

Penalized Sparse Covariance Regression with High Dimensional Covariates

High-dimensional varying index coefficient quantile regression model

On a Principal Varying Coefficient Model

Robust estimation in joint mean–covariance regression model for longitudinal data

A Unified Variable Selection Approach for Varying Coefficient Models

Huber Loss Meets Spatial Autoregressive Model: A Robust Variable Selection Method with Prior Information

Shrinkage Estimation of the Varying Coefficient Model