Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Variable Selection in Robust Semiparametric Modeling for Longitudinal Data

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Robust Variable Selection for Single-Index Varying-Coefficient Model with Missing Data in Covariates

Variable selection for joint mean and covariance models via penalized likelihood

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Model Estimation and Selection for Partial Linear Varying Coefficient EV Models with Longitudinal Data.

Robust Variable Selection in Semiparametric Mean-Covariance Regression for Longitudinal Data Analysis.

Robust Variable Selection in Modal Varying-Coefficient Models with Longitudinal

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Variable Selection for Panel Count Data Via Non‐Concave Penalized Estimating Function

Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models

Robust estimation in joint mean–covariance regression model for longitudinal data

Robust Estimation and Variable Selection for Varying-Coefficient Single-Index Models Based on Modal Regression

Nonnegative Estimation and Variable Selection under Minimax Concave Penalty for Sparse High-Dimensional Linear Regression Models

Joint Variable Selection of Mean-Covariance Model for Longitudinal Data

Variable Selection in Joint Mean and Dispersion Models via Double Penalized Likelihood

Variable Selection in the Partially Linear Errors-in-variables Models for Longitudinal Data

Variable Selection in Robust Regression Models for Longitudinal Data