Abstract:Single-index models are potentially important tools for multivariate nonparametric regression. They generalize linear regression by replacing the linear combination α0Tx with a nonparametric component, η0(α0Tx), where η0(·) is an unknown univariate link function. By reducing the dimensionality from that of a general covariate vector x to a univariate index α0Tx, single-index models avoid the so-called “curse of dimensionality.” We propose penalized spline (P-spline) estimation of η0(·) in partially linear single-index models, where the mean function has the form η0(α0Tx) + β 0Tz. The P-spline approach offers a number of advantages over other fitting methods for single-index models. All parameters in the P-spline single-index model can be estimated simultaneously by penalized nonlinear least squares. As a direct least squares fitting method, our approach is rapid and computationally stable. Standard nonlinear least squares software can be used. Moreover, joint inference for η0(·), α0, and β0 is possible by standard estimating equations theory such as the sandwich formula for the joint covariance matrix. Using asymptotics where the number of knots is fixed, though potentially large, we show √n consistency and asymptotic normality of the estimators of all parameters. These asymptotic results permit joint inference for the parameters. Several examples illustrate that the model and proposed estimation methodology can be effective in practice. We investigate inference based on the sandwich estimate through a Monte Carlo study. GeneralLq penalty functions can be readily implemented.

Penalized Least Squares for Single Index Models

A Lasso-Type Approach for Estimation and Variable Selection in Single Index Models

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

Variable Selection for the Partial Linear Single-Index Model

Efficient penalized estimating method in the partially varying-coefficient single-index model

Nonconcave Penalized Inverse Regression in Single-Index Models with High Dimensional Predictors

Penalized LAD regression for single index models

Variable Selection in a Class of Single-Index Models

Penalized Spline Estimation for Partially Linear Single-Index Models

Penalized quadratic inference functions for single-index models with longitudinal data

Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

The adaptive L1-penalized LAD regression for partially linear single-index models

A robust and efficient estimation and variable selection method for partially linear single-index models.

Robust Variable Selection Based on Penalized Composite Quantile Regression for High-Dimensional Single-Index Models

Local Walsh-average-based Estimation and Variable Selection for Single-Index Models

Variable selection and estimation for semi-parametric multiple-index models

Variable selection for partially linear single-index varying-coefficient model

Variable Selection and Estimation for Partially Linear Single-index Models with Longitudinal Data

New Efficient Estimation and Variable Selection in Models with Single-Index Structure

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Robust Estimation and Variable Selection for Varying-Coefficient Single-Index Models Based on Modal Regression