Abstract:The P-splines of Eilers and Marx (1996) combine a B-spline basis with a discrete quadratic penalty on the basis coefficients, to produce a reduced rank spline like smoother. P-splines have three properties that make them very popular as reduced rank smoothers: i) the basis and the penalty are sparse, enabling efficient computation, especially for Bayesian stochastic simulation; ii) it is possible to flexibly `mix-and-match' the order of B-spline basis and penalty, rather than the order of penalty controlling the order of the basis as in spline smoothing; iii) it is very easy to set up the B-spline basis functions and penalties. The discrete penalties are somewhat less interpretable in terms of function shape than the traditional derivative based spline penalties, but tend towards penalties proportional to traditional spline penalties in the limit of large basis size. However part of the point of P-splines is not to use a large basis size. In addition the spline basis functions arise from solving functional optimization problems involving derivative based penalties, so moving to discrete penalties for smoothing may not always be desirable. The purpose of this note is to point out that the three properties of basis-penalty sparsity, mix-and-match penalization and ease of setup are readily obtainable with B-splines subject to derivative based penalization. The penalty setup typically requires a few lines of code, rather than the two lines typically required for P-splines, but this one off disadvantage seems to be the only one associated with using derivative based penalties. As an example application, it is shown how basis-penalty sparsity enables efficient computation with tensor product smoothers of scattered data.

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Adaptive Penalized Splines for Data Smoothing

Fast Bivariate Penalized Splines: the Sandwich Smoother

Solving Euler equations via two-stage nonparametric penalized splines

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Penalized spline estimation of principal components for sparse functional data: rates of convergence

More efficient approximation of smoothing splines via space-filling basis selection

Efficient estimation of a linear transformation model for current status data via penalized splines

Efficient Computation of Smoothing Splines Via Adaptive Basis Sampling

Naive Penalized Spline Estimators of Derivatives Achieve Optimal Rates of Convergence

Dynamic Penalized Splines for Streaming Data

FUSED KERNEL-SPLINE SMOOTHING FOR REPEATEDLY MEASURED OUTCOMES IN A GENERALIZED PARTIALLY LINEAR MODEL WITH FUNCTIONAL SINGLE INDEX

Efficient Estimation in Single Index Models through Smoothing splines

P-splines with derivative based penalties and tensor product smoothing of unevenly distributed data

Fast Covariance Estimation for Sparse Functional Data

ADDITIVE COEFFICIENT MODELING VIA POLYNOMIAL SPLINE

Adaptive Nonparametric Density Estimation with B-Spline Bases

Penalized Spline Estimation for Partially Linear Single-Index Models

P-splines with an L1 Penalty for Repeated Measures

Adaptive Ridge-Penalized Functional Local Linear Regression

Semi-Smooth Newton Algorithm for Non-Convex Penalized Linear Regression