Abstract:We propose a fast penalized spline method for bivariate smoothing. Univariate P-spline smoothers (Eilers and Marx, 1996) are applied simultaneously along both coordinates. The new smoother has a sandwich form which suggested the name "sandwich smoother" to a referee. The sandwich smoother has a tensor product structure that simplifies an asymptotic analysis and it can be fast computed. We derive a local central limit theorem for the sandwich smoother, with simple expressions for the asymptotic bias and variance, by showing that the sandwich smoother is asymptotically equivalent to a bivariate kernel regression estimator with a product kernel. As far as we are aware, this is the first central limit theorem for a bivariate spline estimator of any type. Our simulation study shows that the sandwich smoother is orders of magnitude faster to compute than other bivariate spline smoothers, even when the latter are computed using a fast GLAM (Generalized Linear Array Model) algorithm, and comparable to them in terms of mean squared integrated errors. We extend the sandwich smoother to array data of higher dimensions, where a GLAM algorithm improves the computational speed of the sandwich smoother. One important application of the sandwich smoother is to estimate covariance functions in functional data analysis. In this application, our numerical results show that the sandwich smoother is orders of magnitude faster than local linear regression. The speed of the sandwich formula is important because functional data sets are becoming quite large.

Efficient and fast spline-backfitted kernel smoothing of additive regression model ∗

Efficient and fast spline-backfitted kernel smoothing of additive models

Spline-Backfitted Kernel Smoothing of Partially Linear Additive Model

Spline-Backfitted Kernel Smoothing Of Nonlinear Additive Autoregression Model

Oracally efficient spline-backfitted kernel smoothing of additive partial linear measurement error model

SPLINE-BACKFITTED KERNEL SMOOTHING OF ADDITIVE COEFFICIENT MODEL

Kernel density regression in the additive model: a B-spline approach

FUSED KERNEL-SPLINE SMOOTHING FOR REPEATEDLY MEASURED OUTCOMES IN A GENERALIZED PARTIALLY LINEAR MODEL WITH FUNCTIONAL SINGLE INDEX

Smooth backfitting in generalized additive models

A Note on the Backfitting Estimation of Additive Models

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Fast Bivariate Penalized Splines: the Sandwich Smoother

Oracally efficient spline smoothing of nonlinear additive autoregression models with simultaneous confidence band

Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions

Linear smoothers and additive models

Adaptive Penalized Splines for Data Smoothing

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Efficient Estimation of Generalized Additive Partially Linear Model

Efficient Estimation of Seemingly Unrelated Additive Nonparametric Regression Models.

ADDITIVE COEFFICIENT MODELING VIA POLYNOMIAL SPLINE

Two-Stage Efficient Estimation of Longitudinal Nonparametric Additive Models