Abstract:We propose a fast penalized spline method for bivariate smoothing. Univariate P-spline smoothers (Eilers and Marx, 1996) are applied simultaneously along both coordinates. The new smoother has a sandwich form which suggested the name "sandwich smoother" to a referee. The sandwich smoother has a tensor product structure that simplifies an asymptotic analysis and it can be fast computed. We derive a local central limit theorem for the sandwich smoother, with simple expressions for the asymptotic bias and variance, by showing that the sandwich smoother is asymptotically equivalent to a bivariate kernel regression estimator with a product kernel. As far as we are aware, this is the first central limit theorem for a bivariate spline estimator of any type. Our simulation study shows that the sandwich smoother is orders of magnitude faster to compute than other bivariate spline smoothers, even when the latter are computed using a fast GLAM (Generalized Linear Array Model) algorithm, and comparable to them in terms of mean squared integrated errors. We extend the sandwich smoother to array data of higher dimensions, where a GLAM algorithm improves the computational speed of the sandwich smoother. One important application of the sandwich smoother is to estimate covariance functions in functional data analysis. In this application, our numerical results show that the sandwich smoother is orders of magnitude faster than local linear regression. The speed of the sandwich formula is important because functional data sets are becoming quite large.

On Knot Placement for Penalized Spline Regression

Spline regression with automatic knot selection

Exact Penalty Method for Knot Selection of B-Spline Regression

Knot Calculation for Spline Fitting Via Sparse Optimization

A local fitting algorithm for converting planar curves to B-splines

Approximate T-Spline Surface Skinning

Mapping-to-Parameter Nonlinear Functional Regression with Novel B-spline Free Knot Placement Algorithm

Adaptive Bayesian Multivariate Spline Knot Inference with Prior Specifications on Model Complexity

Estimation of Knots in Linear Spline Models

Fast Bivariate Penalized Splines: the Sandwich Smoother

Effective Re-Parameterization and GA Based Knot Structure Optimization for High Quality T-spline Surface Fitting

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Fast knot optimization for multivariate adaptive regression splines using hill climbing methods

Dynamic Penalized Splines for Streaming Data

Adaptive Penalized Splines for Data Smoothing

Best free knot linear spline approximation and its application to neural networks

SplineGen: a generative model for B-spline approximation of unorganized points

Statistica Sinica Preprint No : SS-2020-0167 Title Dynamic Penalized Splines for Streaming Data

TWO ALGORITHMS FOR INSERTING KNOTS INTO B-SPLINE CURVES

Error analysis for local coarsening in univariate spline spaces

Knot Selection of Estimating the Term Structure with Cubit Spline Function