Abstract:Single-index models are potentially important tools for multivariate nonparametric regression. They generalize linear regression by replacing the linear combination α0Tx with a nonparametric component, η0(α0Tx), where η0(·) is an unknown univariate link function. By reducing the dimensionality from that of a general covariate vector x to a univariate index α0Tx, single-index models avoid the so-called “curse of dimensionality.” We propose penalized spline (P-spline) estimation of η0(·) in partially linear single-index models, where the mean function has the form η0(α0Tx) + β 0Tz. The P-spline approach offers a number of advantages over other fitting methods for single-index models. All parameters in the P-spline single-index model can be estimated simultaneously by penalized nonlinear least squares. As a direct least squares fitting method, our approach is rapid and computationally stable. Standard nonlinear least squares software can be used. Moreover, joint inference for η0(·), α0, and β0 is possible by standard estimating equations theory such as the sandwich formula for the joint covariance matrix. Using asymptotics where the number of knots is fixed, though potentially large, we show √n consistency and asymptotic normality of the estimators of all parameters. These asymptotic results permit joint inference for the parameters. Several examples illustrate that the model and proposed estimation methodology can be effective in practice. We investigate inference based on the sandwich estimate through a Monte Carlo study. GeneralLq penalty functions can be readily implemented.

Estimating the Conditional Single-Index Error Distribution with A Partial Linear Mean Regression

Empirical Likelihood Based Inference for Conditional Pareto-type Tail Index

Empirical Likelihood for Single-Index Regression Models under Negatively Associated Errors

Single-index relative error regression models

M-ESTIMATORS IN A PARTIAL LINEAR SINGLE-INDEX MODEL

FUSED KERNEL-SPLINE SMOOTHING FOR REPEATEDLY MEASURED OUTCOMES IN A GENERALIZED PARTIALLY LINEAR MODEL WITH FUNCTIONAL SINGLE INDEX

Estimation on functional partially linear single index measurement error model

Estimation and Variable Selection in Partial Linear Single Index Models with Error-Prone Linear Covariates

Estimation of a functional single index model with dependent errors and unknown error density

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Estimation in Partially Linear Single-Index Panel Data Models With Fixed Effects

Estimation and convergence rates in the distributional single index model

A nonparametric estimator for the conditional tail index of Pareto-type distributions

Estimation of single index model with missing response at random

Detection of the symmetry of model errors for partial linear single-index models

Estimation for partially linear single-index spatial autoregressive model with covariate measurement errors

Penalized Spline Estimation for Partially Linear Single-Index Models

Single-index partially functional linear regression model

Quantile regression of partially linear single-index model with missing observations

Inference for Conditional Value-at-risk of a Predictive Regression

Quantile Estimation of A general Single-Index Model