Abstract:Large samples have been generated routinely from various sources. Classic statistical models, such as smoothing spline ANOVA models, are not well equipped to analyze such large samples due to expensive computational costs. In particular, the daunting computational costs of selecting smoothing parameters render smoothing spline ANOVA models impractical. In this article, we develop an asympirical, i.e., asymptotic and empirical, smoothing parameters selection approach for smoothing spline ANOVA models in large samples. The idea of this approach is to use asymptotic analysis to show that the optimal smoothing parameter is a polynomial function of the sample size and an unknown constant. The unknown constant is then estimated through empirical subsample extrapolation. The proposed method significantly reduces the computational costs of selecting smoothing parameters in high-dimensional and large samples. We show smoothing parameters chosen by the proposed method tend to the optimal smoothing parameters that minimise a specific risk function. In addition, the estimator based on the proposed smoothing parameters achieves the optimal convergence rate. Extensive simulation studies demonstrate the numerical advantage of the proposed method over competing methods in terms of relative efficacies and running time. On an application to molecular dynamics data with nearly one million observations, the proposed method has the best prediction performance.

Optimal smoothing parameter selection in single-index model derivative estimation

Efficient Estimation in Single Index Models through Smoothing splines

Direct estimation of the index coefficient in a single-index model

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

A framework to select tuning parameters for nonparametric derivative estimation

Solving Euler equations via two-stage nonparametric penalized splines

Simultaneous semiparametric inference for single-index models

FUSED KERNEL-SPLINE SMOOTHING FOR REPEATEDLY MEASURED OUTCOMES IN A GENERALIZED PARTIALLY LINEAR MODEL WITH FUNCTIONAL SINGLE INDEX

An Asympirical Smoothing Parameters Selection Approach for Smoothing Spline ANOVA Models in Large Samples

Parameter Estimation of Differential Equation Model based on Optimal Weight Choice Method

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Spline Estimation of Single-Index Models

Estimation and convergence rates in the distributional single index model

Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

An alternating determination-optimization approach for an additive multi-index model

Estimating high dimensional monotone index models by iterative convex optimization

Nonparametric Estimation via Partial Derivatives

Multiple smoothing parameters selection in additive regression quantiles

Nonlinear Regression Models With Single-Index Heteroscedasticity