Abstract:Single-index models are potentially important tools for multivariate nonparametric regression. They generalize linear regression by replacing the linear combination α0Tx with a nonparametric component, η0(α0Tx), where η0(·) is an unknown univariate link function. By reducing the dimensionality from that of a general covariate vector x to a univariate index α0Tx, single-index models avoid the so-called “curse of dimensionality.” We propose penalized spline (P-spline) estimation of η0(·) in partially linear single-index models, where the mean function has the form η0(α0Tx) + β 0Tz. The P-spline approach offers a number of advantages over other fitting methods for single-index models. All parameters in the P-spline single-index model can be estimated simultaneously by penalized nonlinear least squares. As a direct least squares fitting method, our approach is rapid and computationally stable. Standard nonlinear least squares software can be used. Moreover, joint inference for η0(·), α0, and β0 is possible by standard estimating equations theory such as the sandwich formula for the joint covariance matrix. Using asymptotics where the number of knots is fixed, though potentially large, we show √n consistency and asymptotic normality of the estimators of all parameters. These asymptotic results permit joint inference for the parameters. Several examples illustrate that the model and proposed estimation methodology can be effective in practice. We investigate inference based on the sandwich estimate through a Monte Carlo study. GeneralLq penalty functions can be readily implemented.

Asymptotic Properties of Penalized Spline Estimators in Concave Extended Linear Models: Rates of Convergence

Penalized spline estimation of principal components for sparse functional data: rates of convergence

Adaptive Penalized Splines for Data Smoothing

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Fast Bivariate Penalized Splines: the Sandwich Smoother

Naive Penalized Spline Estimators of Derivatives Achieve Optimal Rates of Convergence

Penalized Spline Estimation for Varying-Coefficient Models

HAZARD REGRESSION WITH PENALIZED SPLINE:THE SMOOTHING PARAMETER CHOICE AND ASYMPTOTICS

On the Asymptotics of Marginal Regression Splines with Longitudinal Data

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Optimal computational and statistical rates of convergence for sparse nonconvex learning problems

An Efficient Penalized Estimation Approach for Semiparametric Linear Transformation Models with Interval‐censored Data

Estimation and Inference for Varying-Coefficient Models with Nonstationary Regressors Using Penalized Splines

NONCONCAVE PENALIZED M-ESTIMATION WITH A DIVERGING NUMBER OF PARAMETERS

Asymptotics for Penalized Spline Estimators in Quantile Regression

Penalized Spline Estimation for Partially Linear Single-Index Models

Improved convergence rates of nonparametric penalized regression under misspecified total variation

From finite sample to asymptotics: A geometric bridge for selection criteria in spline regression

Efficient estimation of a linear transformation model for current status data via penalized splines

Dynamic Penalized Splines for Streaming Data

RATES OF CONVERGENCE OF M-ESTIMATORS FOR PARTLY LINEAR-MODELS INVOLVING TIME-SERIES