Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density

Bayesian bandwidth estimation for a nonparametric functional regression model with mixed types of regressors and unknown error density

Estimation of a functional single index model with dependent errors and unknown error density

Bayesian estimation for longitudinal data in a joint model with HPCs

Sequential Bayesian bandwidth selection for multivariate kernel regression with applications

Robust Bayesian Inference for Berkson and Classical Measurement Error Models

Empirical-Likelihood-Based Inference for Partially Linear Models

Bayesian Bandwidths in Semiparametric Modelling for Nonnegative Orthant Data with Diagnostics

Stable and bias-corrected estimation for nonparametric regression models

A robust and efficient estimation and variable selection method for partially linear single-index models.

Bayesian Model Selection in High-Dimensional Settings

A KERNEL-BASED METHOD FOR ESTIMATING ADDITIVE PARTIALLY LINEAR MODELS

Statistical Inference for Partially Linear Regression Models with Measurement Errors

Multivariate bandwidth selection for local linear regression

Nonparametric conditional survival function estimation and plug-in bandwidth selection with multiple covariates

Complexity measure, kernel density estimation, bandwidth selection, and the efficient market hypothesis

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Functional and Parametric Estimation in a Semi- and Nonparametric Model with Application to Mass-Spectrometry Data

A Bayesian approach to functional regression: theory and computation

Kernel-based Estimation for Partially Functional Linear Model: Minimax Rates and Randomized Sketches

Bias-corrected Estimations in Varying-Coefficient Partially Nonlinear Models with Measurement Error in the Nonparametric Part