Abstract:We consider the problem of approximating smoothing spline estimators in a nonparametric regression model. When applied to a sample of size [Formula: see text], the smoothing spline estimator can be expressed as a linear combination of [Formula: see text] basis functions, requiring [Formula: see text] computational time when the number [Formula: see text] of predictors is two or more. Such a sizeable computational cost hinders the broad applicability of smoothing splines. In practice, the full-sample smoothing spline estimator can be approximated by an estimator based on [Formula: see text] randomly selected basis functions, resulting in a computational cost of [Formula: see text]. It is known that these two estimators converge at the same rate when [Formula: see text] is of order [Formula: see text], where [Formula: see text] depends on the true function and [Formula: see text] depends on the type of spline. Such a [Formula: see text] is called the essential number of basis functions. In this article, we develop a more efficient basis selection method. By selecting basis functions corresponding to approximately equally spaced observations, the proposed method chooses a set of basis functions with great diversity. The asymptotic analysis shows that the proposed smoothing spline estimator can decrease [Formula: see text] to around [Formula: see text] when [Formula: see text]. Applications to synthetic and real-world datasets show that the proposed method leads to a smaller prediction error than other basis selection methods.

The Method of Universal Penalized Least Squares by Adding Smoothing Parameters Both to the Residual and Systematic Parts

A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

Variable Smoothing Parameter of the Double Exponential Smoothing Forecasting Model and Its Application

An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Comparison of Regularized Least-Squares Approach and Predictive Error Method: Case Studies * *this Work is Supported by the National Science Foundation of China (no. 61273191) and by 973 Program of China (no. 2012CB720500). Corresponding Author Yucai Zhu. Tel. +15381085960. Fax +0571-87953353.

A Smoothing-Type Algorithm for Solving System of Inequalities

Weighted least squares and quasi-weighted least squares combined method for data rectification

Adaptive Penalized Splines for Data Smoothing

On Smoothing Exact Penalty Function for Nonlinear Constrained Optimization Problems

Semi-Smooth Newton Algorithm for Non-Convex Penalized Linear Regression

Sparse Parameter Identification for Stochastic Systems Based on [math] Regularization

On adaptive stochastic extended iterative methods for solving least squares

Efficient Parameters Estimation Method for the Separable Nonlinear Least Squares Problem

On the Least Squares Solutions of a System of Bilinear Equations

Improved Least Square Method Based on Theory of Programming and Application in Parameters Estimating of Markov Jumping Systems

Large System Of Seemingly Unrelated Regressions: A Penalized Quasi-Maximum Likelihood Estimation Perspective

Smooth Adjustment for Correlated Effects

Sequential Quadratic Programming Method for Nonlinear Least Squares Estimation and Its Application

Weighted least squares regression with the best robustness and high computability

More efficient approximation of smoothing splines via space-filling basis selection

A Unified Variable Selection Approach for Varying Coefficient Models