Abstract:We propose a fast penalized spline method for bivariate smoothing. Univariate P-spline smoothers (Eilers and Marx, 1996) are applied simultaneously along both coordinates. The new smoother has a sandwich form which suggested the name "sandwich smoother" to a referee. The sandwich smoother has a tensor product structure that simplifies an asymptotic analysis and it can be fast computed. We derive a local central limit theorem for the sandwich smoother, with simple expressions for the asymptotic bias and variance, by showing that the sandwich smoother is asymptotically equivalent to a bivariate kernel regression estimator with a product kernel. As far as we are aware, this is the first central limit theorem for a bivariate spline estimator of any type. Our simulation study shows that the sandwich smoother is orders of magnitude faster to compute than other bivariate spline smoothers, even when the latter are computed using a fast GLAM (Generalized Linear Array Model) algorithm, and comparable to them in terms of mean squared integrated errors. We extend the sandwich smoother to array data of higher dimensions, where a GLAM algorithm improves the computational speed of the sandwich smoother. One important application of the sandwich smoother is to estimate covariance functions in functional data analysis. In this application, our numerical results show that the sandwich smoother is orders of magnitude faster than local linear regression. The speed of the sandwich formula is important because functional data sets are becoming quite large.

Smoothing Splines Using Compactly Supported, Positive Definite, Radial Basis Functions

Fast Bivariate Penalized Splines: the Sandwich Smoother

Compactly Supported Positive Definite Radial Functions

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Efficient estimation for a smoothing thin plate spline in a two-dimensional space

Kernel Based Approximation in Sobolev Spaces with Radial Basis Functions

Stabilized interpolation using radial basis functions augmented with selected radial polynomials

Hessian Based Smoothing Splines for Manifold Learning

On the Factors Affecting the Accuracy and Robustness of Smoothed-Radial Point Interpolation Method

A Fast Global Optimizer Based on Improved CS-RBF and Stochastic Optimal Algorithm

Adaptive Penalized Splines for Data Smoothing

Robust thin-plate splines for multivariate spatial smoothing

Efficient Computation of Smoothing Splines Via Adaptive Basis Sampling

Extending error bounds for radial basis function interpolation to measuring the error in higher order Sobolev norms

A general class of $C^1$ smooth rational splines: Application to construction of exact ellipses and ellipsoids

More efficient approximation of smoothing splines via space-filling basis selection

Smoothing splines for discontinuous signals

Radial polynomials as alternatives to smooth radial basis functions and their applications

A new type of radial basis functions for problems governed by partial differential equations

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension