Abstract:We propose a fast penalized spline method for bivariate smoothing. Univariate P-spline smoothers (Eilers and Marx, 1996) are applied simultaneously along both coordinates. The new smoother has a sandwich form which suggested the name "sandwich smoother" to a referee. The sandwich smoother has a tensor product structure that simplifies an asymptotic analysis and it can be fast computed. We derive a local central limit theorem for the sandwich smoother, with simple expressions for the asymptotic bias and variance, by showing that the sandwich smoother is asymptotically equivalent to a bivariate kernel regression estimator with a product kernel. As far as we are aware, this is the first central limit theorem for a bivariate spline estimator of any type. Our simulation study shows that the sandwich smoother is orders of magnitude faster to compute than other bivariate spline smoothers, even when the latter are computed using a fast GLAM (Generalized Linear Array Model) algorithm, and comparable to them in terms of mean squared integrated errors. We extend the sandwich smoother to array data of higher dimensions, where a GLAM algorithm improves the computational speed of the sandwich smoother. One important application of the sandwich smoother is to estimate covariance functions in functional data analysis. In this application, our numerical results show that the sandwich smoother is orders of magnitude faster than local linear regression. The speed of the sandwich formula is important because functional data sets are becoming quite large.

Variational Bayesian Lasso for spline regression

Spline regression with automatic knot selection

A Variational Approach for Feature-Aware B-spline Curve Design on Surface Meshes

Multivariate Lévy Adaptive B-Spline Regression

Adaptive Bayesian Multivariate Spline Knot Inference with Prior Specifications on Model Complexity

Fast Bivariate Penalized Splines: the Sandwich Smoother

Mapping-to-Parameter Nonlinear Functional Regression with Novel B-spline Free Knot Placement Algorithm

Exact Penalty Method for Knot Selection of B-Spline Regression

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Synergizing Roughness Penalization and Basis Selection in Bayesian Spline Regression

MARS via LASSO

Spline estimator for ultra-high dimensional partially linear varying coefficient models

ADDITIVE COEFFICIENT MODELING VIA POLYNOMIAL SPLINE

Nonparametric Automatic Differentiation Variational Inference with Spline Approximation

Bayesian Joint Spike-and-Slab Graphical Lasso

Laplace approximation for fast Bayesian inference in generalized additive models based on penalized regression splines

Saturating Splines and Feature Selection

On Knot Placement for Penalized Spline Regression

The Performance of Cross-Validation and Maximum Likelihood Estimators of Spline Smoothing Parameters

Lasso Regression: Estimation and Shrinkage via Limit of Gibbs Sampling

An Extreme Value Bayesian Lasso for the Conditional Left and Right Tails