Abstract:In this paper we discuss the estimation of a nonparametric component $f_1$ of a nonparametric additive model $Y=f_1(X_1) + ...+ f_q(X_q) + \epsilon$. We allow the number $q$ of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimation problem with that of estimating $f_1$ in the oracle model $Z= f_1(X_1) + \epsilon$, for which the additive components $f_2,\dots,f_q$ are known. We construct a two-step presmoothing-and-resmoothing estimator of $f_1$ and state finite-sample bounds for the difference between our estimator and some smoothing estimators $\hat f_1^{\text{(oracle)}}$ in the oracle model. In an asymptotic setting these bounds can be used to show asymptotic equivalence of our estimator and the oracle estimators; the paper thus shows that, asymptotically, under strong enough sparsity conditions, knowledge of $f_2,\dots,f_q$ has no effect on estimation accuracy. Our first step is to estimate $f_1$ with an undersmoothed estimator based on near-orthogonal projections with a group Lasso bias correction. We then construct pseudo responses $\hat Y$ by evaluating a debiased modification of our undersmoothed estimator of $f_1$ at the design points. In the second step the smoothing method of the oracle estimator $\hat f_1^{\text{(oracle)}}$ is applied to a nonparametric regression problem with responses $\hat Y$ and covariates $X_1$. Our mathematical exposition centers primarily on establishing properties of the presmoothing estimator. We present simulation results demonstrating close-to-oracle performance of our estimator in practical applications.

A Seemingly Unrelated Nonparametric Additive Model with Autoregressive Errors

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

Statistical inference on seemingly unrelated non-parametric regression models with serially correlated errors

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Statistical Inference of Seemingly Unrelated Partially Linear Additive Regression Models

MORE EFFICIENT ESTIMATION IN NONPARAMETRIC REGRESSION WITH NONPARAMETRIC AUTOCORRELATED ERRORS

Identification of Non-Linear Additive Autoregressive Models

Spline-Backfitted Kernel Smoothing Of Nonlinear Additive Autoregression Model

Seemingly unrelated nonparametric models with positive correlation and constrained error variances

Estimation of Semi-Parametric Additive Coefficient Model

Testing Additive Separability of Error Term in Nonparametric Structural Models

Statistical inference in functional semiparametric spatial autoregressive model

ADDITIVE COEFFICIENT MODELING VIA POLYNOMIAL SPLINE

Inference for partially linear additive higher-order spatial autoregressive model with spatial autoregressive error and unknown heteroskedasticity

Polynomial-Based Smoothing Estimation for a Semiparametric Accelerated Failure Time Partial Linear Model

On Estimating the Nonparametric Multiplicative Error Models

Estimation for partially linear single-index spatial autoregressive model with covariate measurement errors

Nonparametric Autoregression with Multiplicative Volatility and Additive Mean

Autoregressive Model with Spatial Dependence and Missing Data

Estimation of Semivarying Coefficient Time Series Models with Arma Errors

Statistical inference in sparse high-dimensional additive models