Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Robust Estimation for Function-on-scalar Regression Models

A highly robust estimator through partially likelihood function modeling and its application in computer vision

Robust estimation for functional quadratic regression models

Robust estimation for functional logistic regression models

A Robust Functional Partial Least Squares for Scalar-on-Multiple-Function Regression

Nonlinear Multivariate Function-on-function Regression with Variable Selection

A robust estimation based on penalised regularisation for the varying-coefficient additive model

Robust Estimation for Partial Functional Linear Regression Model Based on Modal Regression

Robust functional regression based on principal components

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Robust Function-on-Function Regression

Estimation and inference for functional linear regression models with partially varying regression coefficients

Robust estimation of the generalised partial linear model with missing covariates

Functional Adaptive Huber Linear Regression

Robust Functional Regression with Discretely Sampled Predictors

Robust group non-convex estimations for high-dimensional partially linear models

Robust estimation of panel data regression models and applications

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Functional Linear Regression with Mixed Predictors

Robust variable selection for partially linear additive models