Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

A Covariance-Free Strictly Complex-Valued Relevance Vector Machine for Reducing the Order of Linear Time-Invariant Systems

Model Order Reduction for High Dimensional Linear Systems Based on Rank-1 Incremental Proper Orthogonal Decomposition.

Multilinear Model Decomposition of MIMO Nonlinear Systems and Its Implication for Multilinear Model-Based Control

A VSC method for MIMO systems based on SVM

A VSC Scheme for Linear MIMO Systems Based on SVM

Improved Covariance Modeling For Maxim Unilikelihood Multiple Subspace Transformations

Large-Dimensional Positive Definite Covariance Estimation for High Frequency Data via Low-rank and Sparse Matrix Decomposition

MIMO decoupling control based on support vector machines αth-order inversion

A Model-Order Reduction Method Based on Krylov Subspaces for Mimo Bilinear Dynamical Systems

Efficient Maximal Coding Rate Reduction by Variational Forms

Covariance Model with General Linear Structure and Divergent Parameters

Improved covariance modeling for maximum likelihood multiple subspace transformations [speech recognition applications]

Simultaneous Dimension Reduction and Variable Selection for Multinomial Logistic Regression

Supervised Multivariate Learning with Simultaneous Feature Auto-grouping and Dimension Reduction

Coherent Set Identification Via Direct Low Rank Maximum Likelihood Estimation

Investigation on the Construction of the Relevance Vector Machine Based on Cross Entropy Minimization

Functional sufficient dimension reduction through distance covariance

Model Order Reduction Based on Dynamic Relative Gain Array for MIMO Systems

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

A model reduction method for large-scale linear multidimensional dynamical systems